root@black-mesa:~# clvmd -d -I openais CLVMD[d6c13780]: Jan 11 04:15:27 CLVMD started CLVMD[d6c13780]: Jan 11 04:15:27 Our local node id is 16779018 CLVMD[d6c13780]: Jan 11 04:15:27 Add_internal_client, fd = 5 CLVMD[d6c13780]: Jan 11 04:15:27 Connected to OpenAIS CLVMD[d6c13780]: Jan 11 04:15:27 Cluster ready, doing some more initialisation CLVMD[d6c13780]: Jan 11 04:15:27 starting LVM thread CLVMD[42661950]: Jan 11 04:15:27 LVM thread function started CLVMD[d6c13780]: Jan 11 04:15:27 clvmd ready for work CLVMD[d6c13780]: Jan 11 04:15:27 Using timeout of 60 seconds CLVMD[d6c13780]: Jan 11 04:15:27 confchg callback. 1 joined, 0 left, 1 members File descriptor 4 (socket:[859772]) leaked on lvm invocation. Parent PID 18119: sh WARNING: Locking disabled. Be careful! This could corrupt your metadata. CLVMD[42661950]: Jan 11 04:15:27 LVM thread waiting for work >> Starting clvmd on the second node... CLVMD[d6c13780]: Jan 11 04:15:37 confchg callback. 1 joined, 0 left, 2 members >> Running `vgchange -a y xenvg` on the first (this) node CLVMD[d6c13780]: Jan 11 04:16:15 Got new connection on fd 7 CLVMD[d6c13780]: Jan 11 04:16:15 Read on local socket 7, len = 28 CLVMD[d6c13780]: Jan 11 04:16:15 creating pipe, [8, 9] CLVMD[d6c13780]: Jan 11 04:16:15 Creating pre&post thread CLVMD[41dba950]: Jan 11 04:16:15 in sub thread: client = 0x69f0a0 CLVMD[41dba950]: Jan 11 04:16:15 Sub thread ready for work. CLVMD[41dba950]: Jan 11 04:16:15 doing PRE command LOCK_VG 'V_xenvg' at 1 (client=0x69f0a0) CLVMD[41dba950]: Jan 11 04:16:15 lock_resource 'V_xenvg-1', flags=0, mode=1 CLVMD[d6c13780]: Jan 11 04:16:15 Created pre&post thread, state = 0 CLVMD[41dba950]: Jan 11 04:16:15 lock_resource returning 1, lock_id=19495cff00000000 CLVMD[41dba950]: Jan 11 04:16:15 unlock_resource V_xenvg-2 CLVMD[41dba950]: Jan 11 04:16:15 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:15 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:15 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:15 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:15 distribute command: XID = 0 CLVMD[d6c13780]: Jan 11 04:16:15 add_to_lvmqueue: cmd=0x69f860. client=0x69f0a0, msg=0x69f1b0, len=28, csid=(nil), xid=0 CLVMD[42661950]: Jan 11 04:16:15 process_work_item: local CLVMD[42661950]: Jan 11 04:16:15 process_local_command: LOCK_VG (0x33) msg=0x69f8a0, msglen =28, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:15 Dropping metadata for VG xenvg CLVMD[42661950]: Jan 11 04:16:15 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:15 Got 1 replies, expecting: 1 CLVMD[42661950]: Jan 11 04:16:15 LVM thread waiting for work CLVMD[41dba950]: Jan 11 04:16:15 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:15 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:15 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:15 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:15 Send local reply CLVMD[d6c13780]: Jan 11 04:16:15 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:15 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:15 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:15 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:15 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:15 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:15 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:15 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:15 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:15 distribute command: XID = 1 CLVMD[d6c13780]: Jan 11 04:16:15 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:15 add_to_lvmqueue: cmd=0x69f860. client=0x69f0a0, msg=0x69f8d0, len=85, csid=(nil), xid=1 CLVMD[42661950]: Jan 11 04:16:15 process_work_item: local CLVMD[42661950]: Jan 11 04:16:15 process_local_command: LOCK_LV (0x32) msg=0x69f930, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:15 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDG0S1TKA1ncBvNuicycVxLjUmIxcB9hIA', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:15 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:15 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:15 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDG0S1TKA1ncBvNuicycVxLjUmIxcB9hIA-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:15 lock_resource returning 1, lock_id=238e1f2900000001 CLVMD[42661950]: Jan 11 04:16:15 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDG0S1TKA1ncBvNuicycVxLjUmIxcB9hIA-2 CLVMD[42661950]: Jan 11 04:16:15 Command return is 0 CLVMD[42661950]: Jan 11 04:16:15 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:15 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:15 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:15 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:15 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:15 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:15 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:15 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:15 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:15 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:15 Send local reply CLVMD[d6c13780]: Jan 11 04:16:15 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:15 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:15 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:15 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:15 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:15 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:15 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:15 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:15 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:15 distribute command: XID = 2 CLVMD[d6c13780]: Jan 11 04:16:15 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:15 add_to_lvmqueue: cmd=0x7a4f70. client=0x69f0a0, msg=0x7ba2f0, len=85, csid=(nil), xid=2 CLVMD[d6c13780]: Jan 11 04:16:15 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:15 process_work_item: local CLVMD[42661950]: Jan 11 04:16:15 process_local_command: LOCK_LV (0x32) msg=0x7ba350, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:15 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDCEol2GgYcT1BAUVYHNK2e4atp4Znxli2', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:15 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:15 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDCEol2GgYcT1BAUVYHNK2e4atp4Znxli2-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:15 lock_resource returning 1, lock_id=507ed7ab00000002 CLVMD[42661950]: Jan 11 04:16:15 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDCEol2GgYcT1BAUVYHNK2e4atp4Znxli2-2 CLVMD[42661950]: Jan 11 04:16:15 Command return is 0 CLVMD[42661950]: Jan 11 04:16:15 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:15 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:15 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:15 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:15 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:15 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:15 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:15 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:15 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:15 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:15 Send local reply CLVMD[d6c13780]: Jan 11 04:16:15 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:15 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:15 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:15 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:15 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:15 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:15 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:15 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:15 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:15 distribute command: XID = 3 CLVMD[d6c13780]: Jan 11 04:16:15 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:15 add_to_lvmqueue: cmd=0x7a4f70. client=0x69f0a0, msg=0x7a4fb0, len=85, csid=(nil), xid=3 CLVMD[d6c13780]: Jan 11 04:16:15 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:15 process_work_item: local CLVMD[42661950]: Jan 11 04:16:15 process_local_command: LOCK_LV (0x32) msg=0x7ba2f0, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:15 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDcw1KpPVM1Ab3X1WEO2mQZUYjwaG3QJwh', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:15 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:15 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDcw1KpPVM1Ab3X1WEO2mQZUYjwaG3QJwh-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:15 lock_resource returning 1, lock_id=79e2a9e300000003 CLVMD[42661950]: Jan 11 04:16:15 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDcw1KpPVM1Ab3X1WEO2mQZUYjwaG3QJwh-2 CLVMD[d6c13780]: Jan 11 04:16:15 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:15 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:15 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:15 Command return is 0 CLVMD[42661950]: Jan 11 04:16:15 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:15 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:15 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:15 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:15 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:15 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:15 Send local reply CLVMD[42661950]: Jan 11 04:16:15 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:15 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:15 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:15 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:15 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:15 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:15 Writing status 0 down pipe 9 CLVMD[d6c13780]: Jan 11 04:16:15 read on PIPE 8: 4 bytes: status: 0 CLVMD[41dba950]: Jan 11 04:16:15 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:15 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:15 distribute command: XID = 4 CLVMD[d6c13780]: Jan 11 04:16:15 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:15 add_to_lvmqueue: cmd=0x7a4f70. client=0x69f0a0, msg=0x7a4fb0, len=85, csid=(nil), xid=4 CLVMD[d6c13780]: Jan 11 04:16:15 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:15 process_work_item: local CLVMD[42661950]: Jan 11 04:16:15 process_local_command: LOCK_LV (0x32) msg=0x7ba2f0, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:15 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDwhKQJNLI8PfDRIo9TAbOo4Nm1SL05xex', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:15 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:15 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDwhKQJNLI8PfDRIo9TAbOo4Nm1SL05xex-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:15 lock_resource returning 1, lock_id=5bd062c200000004 CLVMD[42661950]: Jan 11 04:16:15 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDwhKQJNLI8PfDRIo9TAbOo4Nm1SL05xex-2 CLVMD[42661950]: Jan 11 04:16:15 Command return is 0 CLVMD[42661950]: Jan 11 04:16:15 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:15 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:15 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:15 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:15 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:15 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:15 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:15 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:15 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:15 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:15 Send local reply CLVMD[d6c13780]: Jan 11 04:16:15 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:15 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:15 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:15 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:15 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:15 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:15 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:15 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:15 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:15 distribute command: XID = 5 CLVMD[d6c13780]: Jan 11 04:16:15 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:15 add_to_lvmqueue: cmd=0x7a4f70. client=0x69f0a0, msg=0x7a4fb0, len=85, csid=(nil), xid=5 CLVMD[d6c13780]: Jan 11 04:16:15 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:15 process_work_item: local CLVMD[42661950]: Jan 11 04:16:15 process_local_command: LOCK_LV (0x32) msg=0x7ba2f0, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:15 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDN9gdApqxOfJHsPTYtRNse05fH2YdcHMa', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:15 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:15 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDN9gdApqxOfJHsPTYtRNse05fH2YdcHMa-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:15 lock_resource returning 1, lock_id=216231b00000005 CLVMD[42661950]: Jan 11 04:16:15 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDN9gdApqxOfJHsPTYtRNse05fH2YdcHMa-2 CLVMD[d6c13780]: Jan 11 04:16:15 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:15 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:15 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:15 Command return is 0 CLVMD[42661950]: Jan 11 04:16:15 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:15 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:15 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:15 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:15 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:15 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:15 Send local reply CLVMD[d6c13780]: Jan 11 04:16:15 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:15 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:15 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:15 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:15 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:15 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:15 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:15 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:15 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:15 distribute command: XID = 6 CLVMD[d6c13780]: Jan 11 04:16:15 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:15 add_to_lvmqueue: cmd=0x7baf90. client=0x69f0a0, msg=0x7a4fb0, len=85, csid=(nil), xid=6 CLVMD[d6c13780]: Jan 11 04:16:15 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:15 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:15 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:15 process_work_item: local CLVMD[42661950]: Jan 11 04:16:15 process_local_command: LOCK_LV (0x32) msg=0x7bb3d0, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:15 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD2ItgPxeKPHDIB2jEnAuEApo0zztHOyuz', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:15 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD2ItgPxeKPHDIB2jEnAuEApo0zztHOyuz-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:15 lock_resource returning 1, lock_id=66ef438d00000006 CLVMD[42661950]: Jan 11 04:16:15 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD2ItgPxeKPHDIB2jEnAuEApo0zztHOyuz-2 CLVMD[42661950]: Jan 11 04:16:15 Command return is 0 CLVMD[42661950]: Jan 11 04:16:15 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:15 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:15 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:15 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:15 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:15 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:15 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:15 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:15 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:15 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:15 Send local reply CLVMD[d6c13780]: Jan 11 04:16:15 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:15 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:15 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:15 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:15 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:15 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:15 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:15 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:15 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:15 distribute command: XID = 7 CLVMD[d6c13780]: Jan 11 04:16:15 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:15 add_to_lvmqueue: cmd=0x7baf90. client=0x69f0a0, msg=0x7bb3d0, len=85, csid=(nil), xid=7 CLVMD[d6c13780]: Jan 11 04:16:15 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:15 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:15 process_work_item: local CLVMD[42661950]: Jan 11 04:16:15 process_local_command: LOCK_LV (0x32) msg=0x7a4fb0, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:15 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDFBo1ryJ93ScgX4gbK6O4ycVBwdqwKlqL', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:15 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDFBo1ryJ93ScgX4gbK6O4ycVBwdqwKlqL-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:15 lock_resource returning 1, lock_id=109cf92e00000007 CLVMD[42661950]: Jan 11 04:16:15 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDFBo1ryJ93ScgX4gbK6O4ycVBwdqwKlqL-2 CLVMD[d6c13780]: Jan 11 04:16:15 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:15 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:15 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:15 Command return is 0 CLVMD[42661950]: Jan 11 04:16:15 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:15 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:15 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:15 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:15 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:15 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:15 Send local reply CLVMD[d6c13780]: Jan 11 04:16:15 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:15 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:15 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:15 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:15 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:15 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:15 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:15 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:15 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:15 distribute command: XID = 8 CLVMD[d6c13780]: Jan 11 04:16:15 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:15 add_to_lvmqueue: cmd=0x7bb5c0. client=0x69f0a0, msg=0x7bb3d0, len=85, csid=(nil), xid=8 CLVMD[d6c13780]: Jan 11 04:16:15 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:15 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:15 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:15 process_work_item: local CLVMD[42661950]: Jan 11 04:16:15 process_local_command: LOCK_LV (0x32) msg=0x7bbca0, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:15 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDtWI1Jz2iZm1TH2qZdmsoB3xZXZLwKNMH', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:15 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDtWI1Jz2iZm1TH2qZdmsoB3xZXZLwKNMH-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:15 lock_resource returning 1, lock_id=1befd79f00000008 CLVMD[42661950]: Jan 11 04:16:15 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDtWI1Jz2iZm1TH2qZdmsoB3xZXZLwKNMH-2 CLVMD[d6c13780]: Jan 11 04:16:15 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:15 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:15 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:15 Command return is 0 CLVMD[42661950]: Jan 11 04:16:15 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:15 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:15 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:15 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:15 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:15 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:15 Send local reply CLVMD[d6c13780]: Jan 11 04:16:15 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:15 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:15 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:15 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:15 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:15 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:15 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:15 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:15 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:15 distribute command: XID = 9 CLVMD[d6c13780]: Jan 11 04:16:15 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:15 add_to_lvmqueue: cmd=0x7baf90. client=0x69f0a0, msg=0x7bbc40, len=85, csid=(nil), xid=9 CLVMD[d6c13780]: Jan 11 04:16:15 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:15 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:15 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:15 process_work_item: local CLVMD[42661950]: Jan 11 04:16:15 process_local_command: LOCK_LV (0x32) msg=0x7bba10, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:15 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDyIwFUuVbqmH0IIMO7sOZlZEOOfWsmpzB', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:15 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDyIwFUuVbqmH0IIMO7sOZlZEOOfWsmpzB-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:15 lock_resource returning 1, lock_id=4e6afb6600000009 CLVMD[42661950]: Jan 11 04:16:15 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDyIwFUuVbqmH0IIMO7sOZlZEOOfWsmpzB-2 CLVMD[d6c13780]: Jan 11 04:16:15 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:15 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:15 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:15 Command return is 0 CLVMD[42661950]: Jan 11 04:16:15 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:15 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:15 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:15 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:15 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:15 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:15 Send local reply CLVMD[d6c13780]: Jan 11 04:16:15 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:15 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:15 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:15 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:15 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:15 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:15 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:15 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:15 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:15 distribute command: XID = 10 CLVMD[d6c13780]: Jan 11 04:16:15 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:15 add_to_lvmqueue: cmd=0x7bb3d0. client=0x69f0a0, msg=0x7bbc40, len=85, csid=(nil), xid=10 CLVMD[d6c13780]: Jan 11 04:16:15 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:15 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:15 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:15 process_work_item: local CLVMD[42661950]: Jan 11 04:16:15 process_local_command: LOCK_LV (0x32) msg=0x7bbca0, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:15 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDuQAiGHHayT1qHrfIh8ZIP1ZaW4ql135R', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:15 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDuQAiGHHayT1qHrfIh8ZIP1ZaW4ql135R-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:15 lock_resource returning 1, lock_id=431bd7b70000000a CLVMD[42661950]: Jan 11 04:16:15 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDuQAiGHHayT1qHrfIh8ZIP1ZaW4ql135R-2 CLVMD[d6c13780]: Jan 11 04:16:15 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:15 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:15 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:15 Command return is 0 CLVMD[42661950]: Jan 11 04:16:15 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:15 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:15 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:15 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:15 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:15 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:15 Send local reply CLVMD[d6c13780]: Jan 11 04:16:15 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:15 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:15 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:15 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:15 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:15 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:15 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:15 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:15 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:15 distribute command: XID = 11 CLVMD[d6c13780]: Jan 11 04:16:15 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:15 add_to_lvmqueue: cmd=0x7bba10. client=0x69f0a0, msg=0x7bbc40, len=85, csid=(nil), xid=11 CLVMD[d6c13780]: Jan 11 04:16:15 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:15 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:15 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:15 process_work_item: local CLVMD[42661950]: Jan 11 04:16:15 process_local_command: LOCK_LV (0x32) msg=0x7b6310, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:15 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD23tycF5wPl6GiwX0IHEzkV01dyDnqaZF', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:15 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD23tycF5wPl6GiwX0IHEzkV01dyDnqaZF-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:15 lock_resource returning 1, lock_id=257130a30000000b CLVMD[42661950]: Jan 11 04:16:15 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD23tycF5wPl6GiwX0IHEzkV01dyDnqaZF-2 CLVMD[42661950]: Jan 11 04:16:15 Command return is 0 CLVMD[42661950]: Jan 11 04:16:15 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:15 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:15 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:15 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:15 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:15 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:15 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:15 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:15 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:15 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:15 Send local reply CLVMD[d6c13780]: Jan 11 04:16:15 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:15 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:15 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:15 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:15 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:15 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:15 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:15 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:15 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:15 distribute command: XID = 12 CLVMD[d6c13780]: Jan 11 04:16:15 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:15 add_to_lvmqueue: cmd=0x7bba10. client=0x69f0a0, msg=0x7b6310, len=85, csid=(nil), xid=12 CLVMD[d6c13780]: Jan 11 04:16:15 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:15 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:15 process_work_item: local CLVMD[42661950]: Jan 11 04:16:15 process_local_command: LOCK_LV (0x32) msg=0x7b6790, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:15 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDPuglkHHsLSi2yN4FLEZDwMP10lGgopqn', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:15 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDPuglkHHsLSi2yN4FLEZDwMP10lGgopqn-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:15 lock_resource returning 1, lock_id=628c895d0000000c CLVMD[42661950]: Jan 11 04:16:15 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDPuglkHHsLSi2yN4FLEZDwMP10lGgopqn-2 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 13 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7b67f0. client=0x69f0a0, msg=0x7b6310, len=85, csid=(nil), xid=13 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7b6bc0, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDoRqMHyEDfIMNXvEptfKZeIyXbqY2zLRg', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDoRqMHyEDfIMNXvEptfKZeIyXbqY2zLRg-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=2443a8580000000d CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDoRqMHyEDfIMNXvEptfKZeIyXbqY2zLRg-2 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 14 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7bba10. client=0x69f0a0, msg=0x7b6c90, len=85, csid=(nil), xid=14 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7b6310, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDt0vvftUtVjlWVj5fOMfRi0d6D6UifmAA', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDt0vvftUtVjlWVj5fOMfRi0d6D6UifmAA-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=75a2a8d40000000e CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDt0vvftUtVjlWVj5fOMfRi0d6D6UifmAA-2 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 15 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7b67d0. client=0x69f0a0, msg=0x7b6c90, len=85, csid=(nil), xid=15 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7b77b0, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDL1Ou7AfHIzocbgPwzANQLjGbPs67EZX3', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDL1Ou7AfHIzocbgPwzANQLjGbPs67EZX3-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=4353d0cd0000000f CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDL1Ou7AfHIzocbgPwzANQLjGbPs67EZX3-2 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 16 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7b67d0. client=0x69f0a0, msg=0x7b6c90, len=85, csid=(nil), xid=16 CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7b77b0, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDD89e5c0OmFEiIHuVxGT0DT90Itb2UcB4', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDD89e5c0OmFEiIHuVxGT0DT90Itb2UcB4-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=54e49eb400000010 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDD89e5c0OmFEiIHuVxGT0DT90Itb2UcB4-2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 17 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7b67d0. client=0x69f0a0, msg=0x7b6c90, len=85, csid=(nil), xid=17 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7b77b0, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDf2xZvG2UOWLKly1x85DlCkVKcxQT0PRG', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDf2xZvG2UOWLKly1x85DlCkVKcxQT0PRG-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=836c40e00000011 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDf2xZvG2UOWLKly1x85DlCkVKcxQT0PRG-2 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 18 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7b67d0. client=0x69f0a0, msg=0x7b6c90, len=85, csid=(nil), xid=18 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7b77b0, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDIderL3UGCv31oq3frFcFDbeA5dASaiiX', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDIderL3UGCv31oq3frFcFDbeA5dASaiiX-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=813864100000012 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDIderL3UGCv31oq3frFcFDbeA5dASaiiX-2 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 19 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7b77b0. client=0x69f0a0, msg=0x7b6c90, len=85, csid=(nil), xid=19 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7b8780, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDDFrPtQcjeEsLgZPzcglEsLf8Jc61ug1X', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDDFrPtQcjeEsLgZPzcglEsLf8Jc61ug1X-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=737b8ddc00000013 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDDFrPtQcjeEsLgZPzcglEsLf8Jc61ug1X-2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 20 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7b77b0. client=0x69f0a0, msg=0x7b6c90, len=85, csid=(nil), xid=20 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7b8780, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD0Ol12sYQAkiG002Iqh2A6b7u5g1H0LKh', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD0Ol12sYQAkiG002Iqh2A6b7u5g1H0LKh-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=4516dde900000014 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD0Ol12sYQAkiG002Iqh2A6b7u5g1H0LKh-2 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 21 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7b77b0. client=0x69f0a0, msg=0x7b8780, len=85, csid=(nil), xid=21 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7b6c90, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDOiNCZ14iQ5U4plIDaP3YHmXv28hUK7pF', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDOiNCZ14iQ5U4plIDaP3YHmXv28hUK7pF-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=419ac24100000015 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDOiNCZ14iQ5U4plIDaP3YHmXv28hUK7pF-2 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 22 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7b77b0. client=0x69f0a0, msg=0x7b6c90, len=85, csid=(nil), xid=22 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7b8780, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDiqIJzFn2iV2a7secfuMScxfcZSdGDpe3', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDiqIJzFn2iV2a7secfuMScxfcZSdGDpe3-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=507236700000016 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDiqIJzFn2iV2a7secfuMScxfcZSdGDpe3-2 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 23 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7b77b0. client=0x69f0a0, msg=0x7b8780, len=85, csid=(nil), xid=23 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 process_local_command: LOCK_LV (0x32) msg=0x7b6c90, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD4ZEby6Nte8Ig7KtGVRbMIzEmnEJ2czj3', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD4ZEby6Nte8Ig7KtGVRbMIzEmnEJ2czj3-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=7724c67e00000017 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD4ZEby6Nte8Ig7KtGVRbMIzEmnEJ2czj3-2 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 24 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000a00. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=24 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDP5rTISMb9jkdesdVB1B9eIF5v0KEQ8Cd', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDP5rTISMb9jkdesdVB1B9eIF5v0KEQ8Cd-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=5e884adc00000018 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDP5rTISMb9jkdesdVB1B9eIF5v0KEQ8Cd-2 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 25 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000a00. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=25 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDP3I8F4CKtk8qqzXWnJoLsEW5hY2kpJro', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDP3I8F4CKtk8qqzXWnJoLsEW5hY2kpJro-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=580bd78f00000019 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDP3I8F4CKtk8qqzXWnJoLsEW5hY2kpJro-2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 26 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000a00. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=26 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDUIgB1AuXUuY0OEsPoduk7xPkNieHojpr', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDUIgB1AuXUuY0OEsPoduk7xPkNieHojpr-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=70a64e2a0000001a CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDUIgB1AuXUuY0OEsPoduk7xPkNieHojpr-2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 27 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000a00. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=27 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDdvZmKAgqwzCQ9EB0tipCncnuoQyJXPmq', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDdvZmKAgqwzCQ9EB0tipCncnuoQyJXPmq-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=1d4ed43b0000001b CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDdvZmKAgqwzCQ9EB0tipCncnuoQyJXPmq-2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 28 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000a00. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=28 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDO0CjIpHf8AyC6vIuc1wB2YJ5idPpMCGP', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDO0CjIpHf8AyC6vIuc1wB2YJ5idPpMCGP-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=57e4ccaf0000001c CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDO0CjIpHf8AyC6vIuc1wB2YJ5idPpMCGP-2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 29 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000a00. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=29 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD0QL4DkLUXjJ10B1GhUG5tD7v1q4fBbjJ', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD0QL4DkLUXjJ10B1GhUG5tD7v1q4fBbjJ-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=542289ec0000001d CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD0QL4DkLUXjJ10B1GhUG5tD7v1q4fBbjJ-2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 30 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000a00. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=30 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDEXLORVVDt2KsaXb90Ksi6jbroGorOpaC', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDEXLORVVDt2KsaXb90Ksi6jbroGorOpaC-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=7644a45c0000001e CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDEXLORVVDt2KsaXb90Ksi6jbroGorOpaC-2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 31 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000a00. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=31 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDvDzTbfHMnV4pPDC0ArNzFzHQY5MARDH5', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDvDzTbfHMnV4pPDC0ArNzFzHQY5MARDH5-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=579478fe0000001f CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDvDzTbfHMnV4pPDC0ArNzFzHQY5MARDH5-2 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 32 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000a00. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=32 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDsvvMg4ZN3qBG2HaYY829kvD1hOq7V3hQ', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDsvvMg4ZN3qBG2HaYY829kvD1hOq7V3hQ-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=1ba026fa00000020 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDsvvMg4ZN3qBG2HaYY829kvD1hOq7V3hQ-2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 33 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000a00. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=33 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDhiBxedY2VL7rZb6tdApsn6KqijVoIyTr', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDhiBxedY2VL7rZb6tdApsn6KqijVoIyTr-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=12e685fb00000021 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDhiBxedY2VL7rZb6tdApsn6KqijVoIyTr-2 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[42661950]: Jan 11 04:16:16 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 34 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000a00. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=34 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD7bCpwAqpPeADbReckIcsdSSczjRA1LJZ', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD7bCpwAqpPeADbReckIcsdSSczjRA1LJZ-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=374a3fe600000022 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD7bCpwAqpPeADbReckIcsdSSczjRA1LJZ-2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 35 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000a00. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=35 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDaf8n6bf1FW83Dl488O7ZeqZe2sNVWBZi', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDaf8n6bf1FW83Dl488O7ZeqZe2sNVWBZi-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=649bb77c00000023 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDaf8n6bf1FW83Dl488O7ZeqZe2sNVWBZi-2 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 36 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000a00. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=36 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDXX5xwjG40gNjYmkGI5Owen1LR00on2DC', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDXX5xwjG40gNjYmkGI5Owen1LR00on2DC-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=1cf10fd800000024 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDXX5xwjG40gNjYmkGI5Owen1LR00on2DC-2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 37 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000a00. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=37 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDoTDYS82Qq11WPScw94H8mKvrT6LYVy6Q', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDoTDYS82Qq11WPScw94H8mKvrT6LYVy6Q-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=47398c8900000025 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDoTDYS82Qq11WPScw94H8mKvrT6LYVy6Q-2 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 38 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000a00. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=38 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD8hQaQq3e7Yab7RjfF8yeZ3c1AEMoOfp3', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD8hQaQq3e7Yab7RjfF8yeZ3c1AEMoOfp3-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=741226bb00000026 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD8hQaQq3e7Yab7RjfF8yeZ3c1AEMoOfp3-2 CLVMD[42661950]: Jan 11 04:16:16 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 1 replies, expecting: 2 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 39 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=39 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a40, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD83W6PGmW6YSZzvOr7kqOAgqx4QRntwtR', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD83W6PGmW6YSZzvOr7kqOAgqx4QRntwtR-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=3f6ab60f00000027 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD83W6PGmW6YSZzvOr7kqOAgqx4QRntwtR-2 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 40 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=40 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDkusFhViQ0I38W41y92wSt2oWgqXAcvPC', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDkusFhViQ0I38W41y92wSt2oWgqXAcvPC-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=77ae35eb00000028 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDkusFhViQ0I38W41y92wSt2oWgqXAcvPC-2 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 41 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=41 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDdpeLKo5fWeB2In20DonntCmsj6JOEzRx', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDdpeLKo5fWeB2In20DonntCmsj6JOEzRx-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=5ff87e0500000029 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDdpeLKo5fWeB2In20DonntCmsj6JOEzRx-2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 42 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=42 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDNIl4E1MEtLzcloafn1jMcpY3X58LaoUQ', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDNIl4E1MEtLzcloafn1jMcpY3X58LaoUQ-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=1dbabf000000002a CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDNIl4E1MEtLzcloafn1jMcpY3X58LaoUQ-2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 43 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=43 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDc51KIxrTdLTKsoM6p5xrkILkFnOGCwFW', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDc51KIxrTdLTKsoM6p5xrkILkFnOGCwFW-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=1381823a0000002b CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDc51KIxrTdLTKsoM6p5xrkILkFnOGCwFW-2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 44 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=44 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDcJNTs0Qoq3ImGk9jZvO00f8cxo88Df8r', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDcJNTs0Qoq3ImGk9jZvO00f8cxo88Df8r-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=6590700b0000002c CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDcJNTs0Qoq3ImGk9jZvO00f8cxo88Df8r-2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 45 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=45 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD2QLzQvQfUGqF2DEkgHRe0jZgYh4vrhBh', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD2QLzQvQfUGqF2DEkgHRe0jZgYh4vrhBh-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=98a31480000002d CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD2QLzQvQfUGqF2DEkgHRe0jZgYh4vrhBh-2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 46 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=46 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDTlJm44UpMfQDWPxzm5WerzUoVG4DPPDR', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDTlJm44UpMfQDWPxzm5WerzUoVG4DPPDR-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=42c296bd0000002e CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDTlJm44UpMfQDWPxzm5WerzUoVG4DPPDR-2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 47 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=47 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDSibl9xWbKNEDCeEGFjudZp1qQto9MTCZ', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDSibl9xWbKNEDCeEGFjudZp1qQto9MTCZ-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=661e3f1e0000002f CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDSibl9xWbKNEDCeEGFjudZp1qQto9MTCZ-2 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 48 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=48 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[d6c13780]: Jan 11 04:16:16 CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD65damDmH3LZdQgxqSfRLoRWjrqSVR9D4', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD65damDmH3LZdQgxqSfRLoRWjrqSVR9D4-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=7bd3ee7b00000030 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD65damDmH3LZdQgxqSfRLoRWjrqSVR9D4-2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 49 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=49 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDlvFrDBDMo06Qbl7TAcfmvJ7zsjS7aE7K', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDlvFrDBDMo06Qbl7TAcfmvJ7zsjS7aE7K-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=bf72b1400000031 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDlvFrDBDMo06Qbl7TAcfmvJ7zsjS7aE7K-2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 50 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=50 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDkzIByBaeg3joE7SFXfAocggvIWjYX0mx', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDkzIByBaeg3joE7SFXfAocggvIWjYX0mx-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=a0382c500000032 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDkzIByBaeg3joE7SFXfAocggvIWjYX0mx-2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 51 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=51 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDk7ehfCrhz6CrpXvHlyyrT7ja0OTwxJpe', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDk7ehfCrhz6CrpXvHlyyrT7ja0OTwxJpe-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=3b0fd37900000033 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDk7ehfCrhz6CrpXvHlyyrT7ja0OTwxJpe-2 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 52 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=52 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDfGMtVDT9T23aE3214vdQ3csYo4UORwt9', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDfGMtVDT9T23aE3214vdQ3csYo4UORwt9-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=60b6df7000000034 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDfGMtVDT9T23aE3214vdQ3csYo4UORwt9-2 CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 53 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=53 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD1eE5zmeBs1uDCuRRbOYoogFQgUJMKrAt', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD1eE5zmeBs1uDCuRRbOYoogFQgUJMKrAt-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=7fffca1100000035 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD1eE5zmeBs1uDCuRRbOYoogFQgUJMKrAt-2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 54 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=54 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD0gZ407XnvEWbc9OUg6FSxIDa03SaiH1c', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD0gZ407XnvEWbc9OUg6FSxIDa03SaiH1c-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=100f59dc00000036 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD0gZ407XnvEWbc9OUg6FSxIDa03SaiH1c-2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 55 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=55 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD7oiUBodFYKF12T2unREJLbA75knz6Kkc', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD7oiUBodFYKF12T2unREJLbA75knz6Kkc-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=6f6dd9ac00000037 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD7oiUBodFYKF12T2unREJLbA75knz6Kkc-2 CLVMD[42661950]: Jan 11 04:16:16 Command return is 0 CLVMD[42661950]: Jan 11 04:16:16 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:16 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:16 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:16 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:16 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:16 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:16 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 Send local reply CLVMD[d6c13780]: Jan 11 04:16:16 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:16 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:16 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:16 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:16 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:16 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:16 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:16 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:16 distribute command: XID = 56 CLVMD[d6c13780]: Jan 11 04:16:16 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:16 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=56 CLVMD[d6c13780]: Jan 11 04:16:16 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:16 process_work_item: local CLVMD[42661950]: Jan 11 04:16:16 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:16 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDoq3nPcqgLXjBmlSQ6ubZA7q3jomzua78', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:16 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:16 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDoq3nPcqgLXjBmlSQ6ubZA7q3jomzua78-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:16 lock_resource returning 1, lock_id=7627211000000038 CLVMD[42661950]: Jan 11 04:16:16 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDoq3nPcqgLXjBmlSQ6ubZA7q3jomzua78-2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 57 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=57 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDdJ1blgZQFUSmDTfuzAObDwcWqD23AJeF', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDdJ1blgZQFUSmDTfuzAObDwcWqD23AJeF-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=14e17e3300000039 CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDdJ1blgZQFUSmDTfuzAObDwcWqD23AJeF-2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 58 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=58 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDqh0TdC4igfm3nTX7aUFgFZ5KiIgPI9E6', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDqh0TdC4igfm3nTX7aUFgFZ5KiIgPI9E6-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=68ebc5500000003a CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDqh0TdC4igfm3nTX7aUFgFZ5KiIgPI9E6-2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 59 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=59 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDS4jsfYr8FQT9G9mSa170gE4yaCOpUyl5', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDS4jsfYr8FQT9G9mSa170gE4yaCOpUyl5-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=4a2ac3150000003b CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDS4jsfYr8FQT9G9mSa170gE4yaCOpUyl5-2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 60 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=60 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDbpNkJcnDdw2qgyH5E60gP3oxU7sXh5en', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDbpNkJcnDdw2qgyH5E60gP3oxU7sXh5en-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=cc1016f0000003c CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDbpNkJcnDdw2qgyH5E60gP3oxU7sXh5en-2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 61 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=61 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD564jb7CIof4dOH3drBcTOipgGJHxFslM', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD564jb7CIof4dOH3drBcTOipgGJHxFslM-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=26f324ba0000003d CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD564jb7CIof4dOH3drBcTOipgGJHxFslM-2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 62 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=62 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDom0GRLT310EukHUAdJw3Al8C41T3uGeC', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDom0GRLT310EukHUAdJw3Al8C41T3uGeC-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=7055a5f50000003e CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDom0GRLT310EukHUAdJw3Al8C41T3uGeC-2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 63 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=63 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDvmlOe0fCdtC9HfAGeDMpBRddYwEADoKw', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDvmlOe0fCdtC9HfAGeDMpBRddYwEADoKw-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=488ac1a0000003f CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDvmlOe0fCdtC9HfAGeDMpBRddYwEADoKw-2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 64 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=64 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDO5irfAzmHRwuW9EEBfPcsCyV5EWOyd5f', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDO5irfAzmHRwuW9EEBfPcsCyV5EWOyd5f-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=7672bd2300000040 CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDO5irfAzmHRwuW9EEBfPcsCyV5EWOyd5f-2 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 65 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=65 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDGKKdfkznLxGncmcj5WxrE598jcjH9HHC', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDGKKdfkznLxGncmcj5WxrE598jcjH9HHC-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=7d5e18f800000041 CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDGKKdfkznLxGncmcj5WxrE598jcjH9HHC-2 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 66 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=66 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDSLr0jiRN8lytqhzpruY52Bn1gGl94ELv', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDSLr0jiRN8lytqhzpruY52Bn1gGl94ELv-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=7de6771300000042 CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDSLr0jiRN8lytqhzpruY52Bn1gGl94ELv-2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[42661950]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 67 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000b20. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=67 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a00, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDtCfMXD4z7AMTPmNz1WGhfewvZoVVlWHG', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDtCfMXD4z7AMTPmNz1WGhfewvZoVVlWHG-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=14fce74e00000043 CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDtCfMXD4z7AMTPmNz1WGhfewvZoVVlWHG-2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 68 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000b20. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=68 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDuQ0zayGrpbKaTFJrDiOGyYMT8F3Z1QG9', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDuQ0zayGrpbKaTFJrDiOGyYMT8F3Z1QG9-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=9daf63200000044 CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDuQ0zayGrpbKaTFJrDiOGyYMT8F3Z1QG9-2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 69 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000b20. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=69 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDCFdykkYXLD5Is7ATmAqgFSguY8ReFPpD', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDCFdykkYXLD5Is7ATmAqgFSguY8ReFPpD-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=5092ca7900000045 CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDCFdykkYXLD5Is7ATmAqgFSguY8ReFPpD-2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 70 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000b20. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=70 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDj30N6EKe59oHvUe2gTflGscDDkE01jVJ', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDj30N6EKe59oHvUe2gTflGscDDkE01jVJ-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=288f1a3400000046 CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDj30N6EKe59oHvUe2gTflGscDDkE01jVJ-2 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 71 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000b20. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=71 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDovepMRUYbWn9GHWCWtfVZghdj2ws31ac', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDovepMRUYbWn9GHWCWtfVZghdj2ws31ac-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=97e1b4e00000047 CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDovepMRUYbWn9GHWCWtfVZghdj2ws31ac-2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 72 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000b20. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=72 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDHGeRgQoYVp7cq0aa40Fh4EYgaOyN3eeU', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDHGeRgQoYVp7cq0aa40Fh4EYgaOyN3eeU-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=53584bcb00000048 CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDHGeRgQoYVp7cq0aa40Fh4EYgaOyN3eeU-2 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 73 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000980. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=73 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a00, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDEp86eK0JTkWoe0k6Wj0fquRpSUGqS0ha', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDEp86eK0JTkWoe0k6Wj0fquRpSUGqS0ha-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=23d86aac00000049 CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDEp86eK0JTkWoe0k6Wj0fquRpSUGqS0ha-2 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 74 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000b20. client=0x69f0a0, msg=0x7f71d0000a60, len=85, csid=(nil), xid=74 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000ac0, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDhJXsUNHLHffb0JMtmeIGxZxMe9rJsiKw', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDhJXsUNHLHffb0JMtmeIGxZxMe9rJsiKw-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=e7ffa2b0000004a CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDhJXsUNHLHffb0JMtmeIGxZxMe9rJsiKw-2 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 75 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000b20. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=75 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD77qbAFnZ2w59mCHYXwctfDmyCZg133Va', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD77qbAFnZ2w59mCHYXwctfDmyCZg133Va-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=78df6a550000004b CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD77qbAFnZ2w59mCHYXwctfDmyCZg133Va-2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 76 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000b20. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=76 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDbaziQBnkvQivZ670zdo1ZyWNBKNA3RNC', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDbaziQBnkvQivZ670zdo1ZyWNBKNA3RNC-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=6c80ec700000004c CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDbaziQBnkvQivZ670zdo1ZyWNBKNA3RNC-2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 77 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000b20. client=0x69f0a0, msg=0x7f71d00008c0, len=85, csid=(nil), xid=77 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000920, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDy3zpMd2PtkyuAtts8MjXIiFOr1mgGkdy', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDy3zpMd2PtkyuAtts8MjXIiFOr1mgGkdy-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=2c27173b0000004d CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDy3zpMd2PtkyuAtts8MjXIiFOr1mgGkdy-2 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 78 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000b20. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=78 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDSOOdpRXO1dZsH9zeW0O2p2JB98Z3YscI', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDSOOdpRXO1dZsH9zeW0O2p2JB98Z3YscI-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=1df029d30000004e CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDSOOdpRXO1dZsH9zeW0O2p2JB98Z3YscI-2 CLVMD[42661950]: Jan 11 04:16:17 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 1 replies, expecting: 2 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 79 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000ac0. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=79 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d00008c0, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDZ0LnKM1le6GEQSq7xtllJOQZWy4Qf08w', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDZ0LnKM1le6GEQSq7xtllJOQZWy4Qf08w-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=3db012b30000004f CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDZ0LnKM1le6GEQSq7xtllJOQZWy4Qf08w-2 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 80 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000b20. client=0x69f0a0, msg=0x7f71d0000920, len=85, csid=(nil), xid=80 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000980, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD1z5CWixPtLA7gQZ3SUcfOtZNUxzyStHL', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD1z5CWixPtLA7gQZ3SUcfOtZNUxzyStHL-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=175dfcf000000050 CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD1z5CWixPtLA7gQZ3SUcfOtZNUxzyStHL-2 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 81 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000ac0. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=81 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDhCrmvgRbVX7RzQDoP6nCkytMPwatzW34', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDhCrmvgRbVX7RzQDoP6nCkytMPwatzW34-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=34fd6b4f00000051 CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDhCrmvgRbVX7RzQDoP6nCkytMPwatzW34-2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 82 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000ac0. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=82 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDR00KptflvqMM9s4n2qbqonDWCbT4DMAy', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDR00KptflvqMM9s4n2qbqonDWCbT4DMAy-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=519e314900000052 CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDR00KptflvqMM9s4n2qbqonDWCbT4DMAy-2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 83 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000ac0. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=83 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDI6mWs9EXfn9Oeot1937cimKcchioM7Uo', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDI6mWs9EXfn9Oeot1937cimKcchioM7Uo-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=4df72e4e00000053 CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDI6mWs9EXfn9Oeot1937cimKcchioM7Uo-2 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 84 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000ac0. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=84 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD5YxFnfRRU1aDmd1lnyPrKr3u7F8cMSB2', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD5YxFnfRRU1aDmd1lnyPrKr3u7F8cMSB2-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=2a082c7000000054 CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD5YxFnfRRU1aDmd1lnyPrKr3u7F8cMSB2-2 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 85 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000ac0. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=85 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD5HKmjIhLBgozdLq6FYPslwILTHaXc5Wz', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD5HKmjIhLBgozdLq6FYPslwILTHaXc5Wz-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=75e0858a00000055 CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD5HKmjIhLBgozdLq6FYPslwILTHaXc5Wz-2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[41dba950]: Jan 11 04:16:17 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 86 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000ac0. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=86 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD8jemEeJsN80LzSxcrYBgnUYBT6CkRfPs', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD8jemEeJsN80LzSxcrYBgnUYBT6CkRfPs-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=20ee134800000056 CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD8jemEeJsN80LzSxcrYBgnUYBT6CkRfPs-2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 87 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000ac0. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=87 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDJtBYrjPIKKpvfdjUlVk0CfCFj5e8Gtym', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDJtBYrjPIKKpvfdjUlVk0CfCFj5e8Gtym-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=2157f6bc00000057 CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDJtBYrjPIKKpvfdjUlVk0CfCFj5e8Gtym-2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 88 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000ac0. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=88 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDq2KIxDYFSTJEx3FOP2ra3CdHHHo4wRGS', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDq2KIxDYFSTJEx3FOP2ra3CdHHHo4wRGS-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=bffae1800000058 CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDq2KIxDYFSTJEx3FOP2ra3CdHHHo4wRGS-2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 89 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000ac0. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=89 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDtYmDBwEXAL5DsW0Lbe46c5dYmNrPh3Yi', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDtYmDBwEXAL5DsW0Lbe46c5dYmNrPh3Yi-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=49d0feac00000059 CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDtYmDBwEXAL5DsW0Lbe46c5dYmNrPh3Yi-2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 Got 1 replies, expecting: 2 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 90 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000b20. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=90 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d00008c0, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD534kx8pOqmeKlkjWzX423WEERAlGUtCz', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD534kx8pOqmeKlkjWzX423WEERAlGUtCz-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=24f6ab8e0000005a CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD534kx8pOqmeKlkjWzX423WEERAlGUtCz-2 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 91 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000ac0. client=0x69f0a0, msg=0x7f71d0000920, len=85, csid=(nil), xid=91 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000980, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDcRmGCTpVZ5S9YLGgttZprAxGntesFznn', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDcRmGCTpVZ5S9YLGgttZprAxGntesFznn-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=2a31b62d0000005b CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDcRmGCTpVZ5S9YLGgttZprAxGntesFznn-2 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 92 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000b20. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=92 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDTObHv6JAgZznXkY1gJBkjr3bb2BQLmpM', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDTObHv6JAgZznXkY1gJBkjr3bb2BQLmpM-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=7543420000005c CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDTObHv6JAgZznXkY1gJBkjr3bb2BQLmpM-2 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 93 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000ac0. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=93 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 process_local_command: LOCK_LV (0x32) msg=0x7f71d00008c0, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDHYY3avNocprDflIo01rOfA9fI5LIgqvc', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDHYY3avNocprDflIo01rOfA9fI5LIgqvc-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=1816f8c40000005d CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDHYY3avNocprDflIo01rOfA9fI5LIgqvc-2 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 94 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000b20. client=0x69f0a0, msg=0x7f71d0000920, len=85, csid=(nil), xid=94 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000980, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDf1w2hGTGHsY8cMz6cWMPyHIdZd3MK57K', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDf1w2hGTGHsY8cMz6cWMPyHIdZd3MK57K-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=759f82cd0000005e CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDf1w2hGTGHsY8cMz6cWMPyHIdZd3MK57K-2 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 95 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000b20. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=95 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDQ7rgZGsz5TcmfDe7YWzONvFf17jQ3cnZ', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDQ7rgZGsz5TcmfDe7YWzONvFf17jQ3cnZ-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=f819e7f0000005f CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDQ7rgZGsz5TcmfDe7YWzONvFf17jQ3cnZ-2 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 96 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000b20. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=96 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDRHVpTLPntPc1ouZlO1UJqF7Eu2heeBfI', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDRHVpTLPntPc1ouZlO1UJqF7Eu2heeBfI-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=631b64d400000060 CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDRHVpTLPntPc1ouZlO1UJqF7Eu2heeBfI-2 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 97 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000b20. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=97 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDm4pCU6HCO38LEsXxkkfNvW82kVViPqAH', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDm4pCU6HCO38LEsXxkkfNvW82kVViPqAH-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=6e534cde00000061 CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDm4pCU6HCO38LEsXxkkfNvW82kVViPqAH-2 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 98 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000b20. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=98 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDAF7hhRPGkXt8Ae270gz3v7pCY8o0jtYN', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDAF7hhRPGkXt8Ae270gz3v7pCY8o0jtYN-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=46263dec00000062 CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDAF7hhRPGkXt8Ae270gz3v7pCY8o0jtYN-2 CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:17 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:17 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:17 Command return is 0 CLVMD[42661950]: Jan 11 04:16:17 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:17 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:17 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:17 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 Send local reply CLVMD[d6c13780]: Jan 11 04:16:17 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:17 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:17 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:17 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:17 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:17 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:17 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:17 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:17 distribute command: XID = 99 CLVMD[d6c13780]: Jan 11 04:16:17 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:17 add_to_lvmqueue: cmd=0x7f71d0000b20. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=99 CLVMD[d6c13780]: Jan 11 04:16:17 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:17 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:17 process_work_item: local CLVMD[42661950]: Jan 11 04:16:17 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:17 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDieYRLOBpQDurXM2KfusXp1wBtxpHfKsD', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:17 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:17 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDieYRLOBpQDurXM2KfusXp1wBtxpHfKsD-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:17 lock_resource returning 1, lock_id=746f2e3000000063 CLVMD[42661950]: Jan 11 04:16:17 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDieYRLOBpQDurXM2KfusXp1wBtxpHfKsD-2 CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:18 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:18 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:18 Command return is 0 CLVMD[42661950]: Jan 11 04:16:18 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:18 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:18 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:18 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 Send local reply CLVMD[d6c13780]: Jan 11 04:16:18 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:18 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:18 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:18 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:18 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 distribute command: XID = 100 CLVMD[d6c13780]: Jan 11 04:16:18 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:18 add_to_lvmqueue: cmd=0x7f71d0000ac0. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=100 CLVMD[d6c13780]: Jan 11 04:16:18 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:18 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:18 process_work_item: local CLVMD[42661950]: Jan 11 04:16:18 process_local_command: LOCK_LV (0x32) msg=0x7f71d00008c0, msglen =85, client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:18 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDzpAmcR15emP2s8eLtg5cqIFv4eWNReJg', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:18 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDzpAmcR15emP2s8eLtg5cqIFv4eWNReJg-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:18 lock_resource returning 1, lock_id=49c0e82300000064 CLVMD[42661950]: Jan 11 04:16:18 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDzpAmcR15emP2s8eLtg5cqIFv4eWNReJg-2 CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:18 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:18 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:18 Command return is 0 CLVMD[42661950]: Jan 11 04:16:18 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:18 Got 2 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:18 LVM thread waiting for work CLVMD[41dba950]: Jan 11 04:16:18 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:18 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 Send local reply CLVMD[d6c13780]: Jan 11 04:16:18 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:18 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:18 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:18 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:18 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 distribute command: XID = 101 CLVMD[d6c13780]: Jan 11 04:16:18 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:18 add_to_lvmqueue: cmd=0x7f71d0000ac0. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=101 CLVMD[d6c13780]: Jan 11 04:16:18 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:18 process_work_item: local CLVMD[42661950]: Jan 11 04:16:18 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:18 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDIAV1UZ9Q5VoJrqY3977MIlX2aLz1UCIw', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:18 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDIAV1UZ9Q5VoJrqY3977MIlX2aLz1UCIw-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:18 lock_resource returning 1, lock_id=6eaa85fb00000065 CLVMD[42661950]: Jan 11 04:16:18 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDIAV1UZ9Q5VoJrqY3977MIlX2aLz1UCIw-2 CLVMD[42661950]: Jan 11 04:16:18 Command return is 0 CLVMD[42661950]: Jan 11 04:16:18 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:18 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:18 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:18 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:18 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:18 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:18 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 Send local reply CLVMD[d6c13780]: Jan 11 04:16:18 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:18 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:18 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:18 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:18 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 distribute command: XID = 102 CLVMD[d6c13780]: Jan 11 04:16:18 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:18 add_to_lvmqueue: cmd=0x7f71d0000ac0. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=102 CLVMD[d6c13780]: Jan 11 04:16:18 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:18 process_work_item: local CLVMD[42661950]: Jan 11 04:16:18 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:18 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDzOynmB6J90NR6MWqrL0reQcmU6g2TB2E', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:18 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDzOynmB6J90NR6MWqrL0reQcmU6g2TB2E-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:18 lock_resource returning 1, lock_id=6caa230400000066 CLVMD[42661950]: Jan 11 04:16:18 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDzOynmB6J90NR6MWqrL0reQcmU6g2TB2E-2 CLVMD[42661950]: Jan 11 04:16:18 Command return is 0 CLVMD[42661950]: Jan 11 04:16:18 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:18 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:18 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:18 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:18 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:18 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:18 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 Send local reply CLVMD[d6c13780]: Jan 11 04:16:18 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:18 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:18 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:18 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:18 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 distribute command: XID = 103 CLVMD[d6c13780]: Jan 11 04:16:18 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:18 add_to_lvmqueue: cmd=0x7f71d0000ac0. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=103 CLVMD[d6c13780]: Jan 11 04:16:18 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:18 process_work_item: local CLVMD[42661950]: Jan 11 04:16:18 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:18 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDD5ZvtuiQufVarB2OFve85fLLvBoBMyCJ', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:18 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDD5ZvtuiQufVarB2OFve85fLLvBoBMyCJ-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:18 lock_resource returning 1, lock_id=17180b0b00000067 CLVMD[42661950]: Jan 11 04:16:18 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDD5ZvtuiQufVarB2OFve85fLLvBoBMyCJ-2 CLVMD[42661950]: Jan 11 04:16:18 Command return is 0 CLVMD[42661950]: Jan 11 04:16:18 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:18 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:18 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:18 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:18 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:18 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:18 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 Send local reply CLVMD[d6c13780]: Jan 11 04:16:18 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:18 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:18 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:18 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:18 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 distribute command: XID = 104 CLVMD[d6c13780]: Jan 11 04:16:18 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:18 add_to_lvmqueue: cmd=0x7f71d0000ac0. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=104 CLVMD[d6c13780]: Jan 11 04:16:18 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:18 process_work_item: local CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:18 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:18 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDmhIzA5Ofar1Hf0TZPhglIMK24zPw5XS4', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:18 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDmhIzA5Ofar1Hf0TZPhglIMK24zPw5XS4-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:18 lock_resource returning 1, lock_id=11cca8ba00000068 CLVMD[42661950]: Jan 11 04:16:18 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDmhIzA5Ofar1Hf0TZPhglIMK24zPw5XS4-2 CLVMD[42661950]: Jan 11 04:16:18 Command return is 0 CLVMD[42661950]: Jan 11 04:16:18 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:18 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:18 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:18 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:18 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:18 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:18 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 Send local reply CLVMD[d6c13780]: Jan 11 04:16:18 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:18 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:18 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:18 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:18 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 distribute command: XID = 105 CLVMD[d6c13780]: Jan 11 04:16:18 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:18 add_to_lvmqueue: cmd=0x7f71d0000ac0. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=105 CLVMD[d6c13780]: Jan 11 04:16:18 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:18 process_work_item: local CLVMD[42661950]: Jan 11 04:16:18 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:18 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDkOVdQRdP6sYYRTzCpRxDobnc721z4MiH', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:18 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDkOVdQRdP6sYYRTzCpRxDobnc721z4MiH-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:18 lock_resource returning 1, lock_id=6b47f63e00000069 CLVMD[42661950]: Jan 11 04:16:18 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDkOVdQRdP6sYYRTzCpRxDobnc721z4MiH-2 CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:18 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:18 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:18 Command return is 0 CLVMD[42661950]: Jan 11 04:16:18 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:18 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:18 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:18 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 Send local reply CLVMD[d6c13780]: Jan 11 04:16:18 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:18 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:18 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:18 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:18 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 distribute command: XID = 106 CLVMD[d6c13780]: Jan 11 04:16:18 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:18 add_to_lvmqueue: cmd=0x7f71d0000b00. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=106 CLVMD[d6c13780]: Jan 11 04:16:18 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:18 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:18 process_work_item: local CLVMD[42661950]: Jan 11 04:16:18 process_local_command: LOCK_LV (0x32) msg=0x7f71d00008c0, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:18 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDQ7PXHwWdVCYrYRo62pcdrpoUPisR7xCG', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:18 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDQ7PXHwWdVCYrYRo62pcdrpoUPisR7xCG-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:18 lock_resource returning 1, lock_id=1c695dec0000006a CLVMD[42661950]: Jan 11 04:16:18 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDQ7PXHwWdVCYrYRo62pcdrpoUPisR7xCG-2 CLVMD[42661950]: Jan 11 04:16:18 Command return is 0 CLVMD[42661950]: Jan 11 04:16:18 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:18 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:18 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:18 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:18 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:18 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:18 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 Send local reply CLVMD[d6c13780]: Jan 11 04:16:18 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:18 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:18 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:18 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:18 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 distribute command: XID = 107 CLVMD[d6c13780]: Jan 11 04:16:18 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:18 add_to_lvmqueue: cmd=0x7f71d0000b00. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=107 CLVMD[d6c13780]: Jan 11 04:16:18 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:18 process_work_item: local CLVMD[42661950]: Jan 11 04:16:18 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:18 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDUDN3j9Cwf0GgsmAFgjo9bJLeMh3IBgia', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:18 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDUDN3j9Cwf0GgsmAFgjo9bJLeMh3IBgia-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:18 lock_resource returning 1, lock_id=11b1cc330000006b CLVMD[42661950]: Jan 11 04:16:18 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDUDN3j9Cwf0GgsmAFgjo9bJLeMh3IBgia-2 CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:18 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:18 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:18 Command return is 0 CLVMD[42661950]: Jan 11 04:16:18 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:18 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:18 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:18 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 Send local reply CLVMD[d6c13780]: Jan 11 04:16:18 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:18 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:18 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:18 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:18 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 distribute command: XID = 108 CLVMD[d6c13780]: Jan 11 04:16:18 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:18 add_to_lvmqueue: cmd=0x7f71d0000b00. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=108 CLVMD[d6c13780]: Jan 11 04:16:18 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:18 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:18 process_work_item: local CLVMD[42661950]: Jan 11 04:16:18 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:18 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDX53wpPeRlaUYwL1oTLeY2UesOwv04U7I', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:18 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDX53wpPeRlaUYwL1oTLeY2UesOwv04U7I-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:18 lock_resource returning 1, lock_id=774858500000006c CLVMD[42661950]: Jan 11 04:16:18 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDX53wpPeRlaUYwL1oTLeY2UesOwv04U7I-2 CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:18 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:18 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:18 Command return is 0 CLVMD[42661950]: Jan 11 04:16:18 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:18 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:18 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:18 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 Send local reply CLVMD[d6c13780]: Jan 11 04:16:18 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:18 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:18 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:18 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:18 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 distribute command: XID = 109 CLVMD[d6c13780]: Jan 11 04:16:18 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:18 add_to_lvmqueue: cmd=0x7f71d0000ac0. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=109 CLVMD[d6c13780]: Jan 11 04:16:18 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:18 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:18 process_work_item: local CLVMD[42661950]: Jan 11 04:16:18 process_local_command: LOCK_LV (0x32) msg=0x7f71d00008c0, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:18 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDRAm5c0XpkbaVN4yv8tYKH1EwBaoi3ah1', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:18 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDRAm5c0XpkbaVN4yv8tYKH1EwBaoi3ah1-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:18 lock_resource returning 1, lock_id=6b1d2c140000006d CLVMD[42661950]: Jan 11 04:16:18 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDRAm5c0XpkbaVN4yv8tYKH1EwBaoi3ah1-2 CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:18 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:18 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:18 Command return is 0 CLVMD[42661950]: Jan 11 04:16:18 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:18 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:18 Got post command condition... CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 Send local reply CLVMD[41dba950]: Jan 11 04:16:18 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:18 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:18 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:18 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:18 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:18 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 distribute command: XID = 110 CLVMD[d6c13780]: Jan 11 04:16:18 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:18 add_to_lvmqueue: cmd=0x7f71d0000b00. client=0x69f0a0, msg=0x7f71d0000920, len=85, csid=(nil), xid=110 CLVMD[d6c13780]: Jan 11 04:16:18 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:18 LVM thread waiting for work CLVMD[42661950]: Jan 11 04:16:18 process_work_item: local CLVMD[42661950]: Jan 11 04:16:18 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000980, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:18 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD6WsDZhApVvVt1qbIbZdY0TlcgoTeXW7s', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:18 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD6WsDZhApVvVt1qbIbZdY0TlcgoTeXW7s-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:18 lock_resource returning 1, lock_id=2ae05a340000006e CLVMD[42661950]: Jan 11 04:16:18 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD6WsDZhApVvVt1qbIbZdY0TlcgoTeXW7s-2 CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:18 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:18 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:18 Command return is 0 CLVMD[42661950]: Jan 11 04:16:18 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:18 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:18 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:18 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[42661950]: Jan 11 04:16:18 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 Send local reply CLVMD[d6c13780]: Jan 11 04:16:18 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:18 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:18 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:18 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:18 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 distribute command: XID = 111 CLVMD[d6c13780]: Jan 11 04:16:18 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:18 add_to_lvmqueue: cmd=0x7f71d0000b00. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=111 CLVMD[d6c13780]: Jan 11 04:16:18 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:18 process_work_item: local CLVMD[42661950]: Jan 11 04:16:18 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:18 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDioLkiCaqQR6hb2GCzS6cobVF4VxxY1pp', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:18 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDioLkiCaqQR6hb2GCzS6cobVF4VxxY1pp-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:18 lock_resource returning 1, lock_id=4defdfa00000006f CLVMD[42661950]: Jan 11 04:16:18 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDioLkiCaqQR6hb2GCzS6cobVF4VxxY1pp-2 CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:18 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:18 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:18 Command return is 0 CLVMD[42661950]: Jan 11 04:16:18 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:18 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:18 Got post command condition... CLVMD[42661950]: Jan 11 04:16:18 LVM thread waiting for work CLVMD[41dba950]: Jan 11 04:16:18 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 Send local reply CLVMD[d6c13780]: Jan 11 04:16:18 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:18 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:18 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:18 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:18 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 distribute command: XID = 112 CLVMD[d6c13780]: Jan 11 04:16:18 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:18 add_to_lvmqueue: cmd=0x7f71d0000b00. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=112 CLVMD[d6c13780]: Jan 11 04:16:18 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:18 process_work_item: local CLVMD[42661950]: Jan 11 04:16:18 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:18 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD01mcKyjLvxYvLIKt9wl4ADi9OQLafWQo', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:18 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD01mcKyjLvxYvLIKt9wl4ADi9OQLafWQo-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:18 lock_resource returning 1, lock_id=94927a800000070 CLVMD[42661950]: Jan 11 04:16:18 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRD01mcKyjLvxYvLIKt9wl4ADi9OQLafWQo-2 CLVMD[42661950]: Jan 11 04:16:18 Command return is 0 CLVMD[42661950]: Jan 11 04:16:18 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:18 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:18 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:18 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:18 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:18 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:18 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 Send local reply CLVMD[d6c13780]: Jan 11 04:16:18 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:18 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:18 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:18 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:18 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 distribute command: XID = 113 CLVMD[d6c13780]: Jan 11 04:16:18 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:18 add_to_lvmqueue: cmd=0x7f71d0000b00. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=113 CLVMD[d6c13780]: Jan 11 04:16:18 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:18 process_work_item: local CLVMD[42661950]: Jan 11 04:16:18 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:18 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDruDVLd0i93Vmk5AWdUpwfTJEI0PgAghH', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:18 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDruDVLd0i93Vmk5AWdUpwfTJEI0PgAghH-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:18 lock_resource returning 1, lock_id=2e8a639400000071 CLVMD[42661950]: Jan 11 04:16:18 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDruDVLd0i93Vmk5AWdUpwfTJEI0PgAghH-2 CLVMD[42661950]: Jan 11 04:16:18 Command return is 0 CLVMD[42661950]: Jan 11 04:16:18 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:18 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:18 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:18 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:18 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:18 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:18 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 Send local reply CLVMD[d6c13780]: Jan 11 04:16:18 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:18 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:18 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:18 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:18 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 distribute command: XID = 114 CLVMD[d6c13780]: Jan 11 04:16:18 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:18 add_to_lvmqueue: cmd=0x7f71d0000b00. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=114 CLVMD[d6c13780]: Jan 11 04:16:18 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:18 process_work_item: local CLVMD[42661950]: Jan 11 04:16:18 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:18 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDzn2sxRsGBd506274jgMa2h31uHGUMziW', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[42661950]: Jan 11 04:16:18 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDzn2sxRsGBd506274jgMa2h31uHGUMziW-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:18 lock_resource returning 1, lock_id=baac1b400000072 CLVMD[42661950]: Jan 11 04:16:18 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDzn2sxRsGBd506274jgMa2h31uHGUMziW-2 CLVMD[42661950]: Jan 11 04:16:18 Command return is 0 CLVMD[42661950]: Jan 11 04:16:18 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:18 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:18 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:18 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:18 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:18 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:18 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 Send local reply CLVMD[d6c13780]: Jan 11 04:16:18 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:18 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:18 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:18 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:18 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 distribute command: XID = 115 CLVMD[d6c13780]: Jan 11 04:16:18 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:18 add_to_lvmqueue: cmd=0x7f71d0000b00. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=115 CLVMD[d6c13780]: Jan 11 04:16:18 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:18 process_work_item: local CLVMD[42661950]: Jan 11 04:16:18 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:18 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDNF1t6L3wTsEJZLRCUOetuicaDJuAY2Y3', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:18 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDNF1t6L3wTsEJZLRCUOetuicaDJuAY2Y3-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:18 lock_resource returning 1, lock_id=4ab26e7800000073 CLVMD[42661950]: Jan 11 04:16:18 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDNF1t6L3wTsEJZLRCUOetuicaDJuAY2Y3-2 CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:18 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:18 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:18 Command return is 0 CLVMD[42661950]: Jan 11 04:16:18 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:18 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:18 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:18 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[42661950]: Jan 11 04:16:18 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 Send local reply CLVMD[d6c13780]: Jan 11 04:16:18 Read on local socket 7, len = 85 CLVMD[d6c13780]: Jan 11 04:16:18 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:16:18 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:16:18 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:18 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:18 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 distribute command: XID = 116 CLVMD[d6c13780]: Jan 11 04:16:18 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:16:18 add_to_lvmqueue: cmd=0x7f71d0000b00. client=0x69f0a0, msg=0x7f71d0000a00, len=85, csid=(nil), xid=116 CLVMD[d6c13780]: Jan 11 04:16:18 Sending message to all cluster nodes CLVMD[42661950]: Jan 11 04:16:18 process_work_item: local CLVMD[42661950]: Jan 11 04:16:18 process_local_command: LOCK_LV (0x32) msg=0x7f71d0000a60, msglen =85, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:18 do_lock_lv: resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDnMTOxRZlLWUGDTzA5bb1Nd827fesVPiY', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[42661950]: Jan 11 04:16:18 lock_resource 'wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDnMTOxRZlLWUGDTzA5bb1Nd827fesVPiY-1', flags=1, mode=1 CLVMD[42661950]: Jan 11 04:16:18 lock_resource returning 1, lock_id=6181ef6900000074 CLVMD[42661950]: Jan 11 04:16:18 unlock_resource wsP9VFcOvS3yZ1A3O47MfaF4jP3YcuRDnMTOxRZlLWUGDTzA5bb1Nd827fesVPiY-2 CLVMD[d6c13780]: Jan 11 04:16:18 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:16:18 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:16:18 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:16:18 Command return is 0 CLVMD[42661950]: Jan 11 04:16:18 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:18 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:16:18 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:18 Waiting for next pre command CLVMD[42661950]: Jan 11 04:16:18 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 Send local reply CLVMD[d6c13780]: Jan 11 04:16:18 Read on local socket 7, len = 28 CLVMD[41dba950]: Jan 11 04:16:18 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:18 doing PRE command LOCK_VG 'V_xenvg' at 6 (client=0x69f0a0) CLVMD[41dba950]: Jan 11 04:16:18 unlock_resource V_xenvg-1 CLVMD[41dba950]: Jan 11 04:16:18 unlock_resource: lockid: 19495cff00000000 CLVMD[41dba950]: Jan 11 04:16:18 unlock_resource V_xenvg-2 CLVMD[41dba950]: Jan 11 04:16:18 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:16:18 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 distribute command: XID = 117 CLVMD[d6c13780]: Jan 11 04:16:18 add_to_lvmqueue: cmd=0x7f71d0000b00. client=0x69f0a0, msg=0x7f71d0000a00, len=28, csid=(nil), xid=117 CLVMD[42661950]: Jan 11 04:16:18 process_work_item: local CLVMD[42661950]: Jan 11 04:16:18 process_local_command: LOCK_VG (0x33) msg=0x7f71d0000a30, msglen =28, client=0x69f0a0 CLVMD[42661950]: Jan 11 04:16:18 Dropping metadata for VG xenvg CLVMD[42661950]: Jan 11 04:16:18 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:16:18 Got 1 replies, expecting: 1 CLVMD[42661950]: Jan 11 04:16:18 LVM thread waiting for work CLVMD[41dba950]: Jan 11 04:16:18 Got post command condition... CLVMD[41dba950]: Jan 11 04:16:18 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:16:18 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:16:18 background routine status was 0, sock_client=0x69f0a0 CLVMD[d6c13780]: Jan 11 04:16:18 Send local reply CLVMD[d6c13780]: Jan 11 04:16:18 Read on local socket 7, len = 0 CLVMD[d6c13780]: Jan 11 04:16:18 EOF on local socket: inprogress=0 CLVMD[d6c13780]: Jan 11 04:16:18 Waiting for child thread CLVMD[41dba950]: Jan 11 04:16:18 Got pre command condition... CLVMD[41dba950]: Jan 11 04:16:18 Subthread finished CLVMD[d6c13780]: Jan 11 04:16:18 Joined child thread CLVMD[d6c13780]: Jan 11 04:16:18 ret == 0, errno = 111. removing client CLVMD[d6c13780]: Jan 11 04:16:18 add_to_lvmqueue: cmd=0x7f71d0000b00. client=0x69f0a0, msg=(nil), len=0, csid=(nil), xid=117 CLVMD[42661950]: Jan 11 04:16:18 process_work_item: free fd 7 CLVMD[42661950]: Jan 11 04:16:18 LVM thread waiting for work >> Now two lvcreates started immediately after the other. This node first. >> On this node, I run `lvcreate -L 1G -n broder-test-1 xenvg` CLVMD[d6c13780]: Jan 11 04:17:28 Got new connection on fd 7 CLVMD[d6c13780]: Jan 11 04:17:28 Read on local socket 7, len = 28 CLVMD[d6c13780]: Jan 11 04:17:28 creating pipe, [8, 9] CLVMD[d6c13780]: Jan 11 04:17:28 Creating pre&post thread CLVMD[41dba950]: Jan 11 04:17:28 in sub thread: client = 0x7f71d00008c0 CLVMD[41dba950]: Jan 11 04:17:28 Sub thread ready for work. CLVMD[41dba950]: Jan 11 04:17:28 doing PRE command LOCK_VG 'V_xenvg' at 4 (client=0x7f71d00008c0) CLVMD[41dba950]: Jan 11 04:17:28 lock_resource 'V_xenvg-2', flags=0, mode=2 CLVMD[d6c13780]: Jan 11 04:17:28 Created pre&post thread, state = 0 CLVMD[41dba950]: Jan 11 04:17:28 lock_resource returning 1, lock_id=710757d000000000 CLVMD[41dba950]: Jan 11 04:17:28 unlock_resource V_xenvg-1 CLVMD[41dba950]: Jan 11 04:17:28 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:17:28 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:17:28 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:17:28 background routine status was 0, sock_client=0x7f71d00008c0 CLVMD[d6c13780]: Jan 11 04:17:28 distribute command: XID = 118 CLVMD[d6c13780]: Jan 11 04:17:28 add_to_lvmqueue: cmd=0x7f71d0000b00. client=0x7f71d00008c0, msg=0x7f71d0000a00, len=28, csid=(nil), xid=118 CLVMD[42661950]: Jan 11 04:17:28 process_work_item: local CLVMD[42661950]: Jan 11 04:17:28 process_local_command: LOCK_VG (0x33) msg=0x7f71d0000a30, msglen =28, client=0x7f71d00008c0 CLVMD[42661950]: Jan 11 04:17:28 Dropping metadata for VG xenvg CLVMD[42661950]: Jan 11 04:17:28 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:17:28 Got 1 replies, expecting: 1 CLVMD[42661950]: Jan 11 04:17:28 LVM thread waiting for work CLVMD[41dba950]: Jan 11 04:17:28 Got post command condition... CLVMD[41dba950]: Jan 11 04:17:28 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:17:28 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:17:28 background routine status was 0, sock_client=0x7f71d00008c0 CLVMD[d6c13780]: Jan 11 04:17:28 Send local reply CLVMD[d6c13780]: Jan 11 04:17:28 Read on local socket 7, len = 28 CLVMD[d6c13780]: Jan 11 04:17:28 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:17:28 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:17:28 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:17:28 Got pre command condition... CLVMD[41dba950]: Jan 11 04:17:28 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:17:28 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:17:28 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:17:28 background routine status was 0, sock_client=0x7f71d00008c0 CLVMD[d6c13780]: Jan 11 04:17:28 distribute command: XID = 119 CLVMD[d6c13780]: Jan 11 04:17:28 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:17:28 add_to_lvmqueue: cmd=0x7f71d0000b00. client=0x7f71d00008c0, msg=0x7f71d0000a00, len=28, csid=(nil), xid=119 CLVMD[42661950]: Jan 11 04:17:28 process_work_item: local CLVMD[42661950]: Jan 11 04:17:28 process_local_command: LOCK_VG (0x33) msg=0x7f71d0000a30, msglen =28, client=0x7f71d00008c0 CLVMD[42661950]: Jan 11 04:17:28 Dropping metadata for VG xenvg CLVMD[42661950]: Jan 11 04:17:28 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:17:28 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:17:28 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:17:28 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:17:28 16779018 got message from nodeid 16779018 for 0. len 28 CLVMD[d6c13780]: Jan 11 04:17:28 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:17:28 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:17:28 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:17:28 Got post command condition... CLVMD[41dba950]: Jan 11 04:17:28 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:17:28 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:17:28 background routine status was 0, sock_client=0x7f71d00008c0 CLVMD[d6c13780]: Jan 11 04:17:28 Send local reply CLVMD[d6c13780]: Jan 11 04:17:28 Read on local socket 7, len = 28 CLVMD[d6c13780]: Jan 11 04:17:28 check_all_clvmds_running CLVMD[d6c13780]: Jan 11 04:17:28 down_callback. node 16779018, state = 3 CLVMD[d6c13780]: Jan 11 04:17:28 down_callback. node 33556234, state = 3 CLVMD[41dba950]: Jan 11 04:17:28 Got pre command condition... CLVMD[41dba950]: Jan 11 04:17:28 Writing status 0 down pipe 9 CLVMD[41dba950]: Jan 11 04:17:28 Waiting to do post command - state = 0 CLVMD[d6c13780]: Jan 11 04:17:28 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:17:28 background routine status was 0, sock_client=0x7f71d00008c0 CLVMD[d6c13780]: Jan 11 04:17:28 distribute command: XID = 120 CLVMD[d6c13780]: Jan 11 04:17:28 num_nodes = 2 CLVMD[d6c13780]: Jan 11 04:17:28 add_to_lvmqueue: cmd=0x7f71d0000b00. client=0x7f71d00008c0, msg=0x7f71d0000a00, len=28, csid=(nil), xid=120 CLVMD[42661950]: Jan 11 04:17:28 process_work_item: local CLVMD[42661950]: Jan 11 04:17:28 process_local_command: LOCK_VG (0x33) msg=0x7f71d0000a30, msglen =28, client=0x7f71d00008c0 CLVMD[42661950]: Jan 11 04:17:28 Dropping metadata for VG xenvg CLVMD[42661950]: Jan 11 04:17:28 Reply from node 100070a: 0 bytes CLVMD[42661950]: Jan 11 04:17:28 Got 1 replies, expecting: 2 CLVMD[42661950]: Jan 11 04:17:28 LVM thread waiting for work CLVMD[d6c13780]: Jan 11 04:17:28 Sending message to all cluster nodes CLVMD[d6c13780]: Jan 11 04:17:28 16779018 got message from nodeid 16779018 for 0. len 28 CLVMD[d6c13780]: Jan 11 04:17:28 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[d6c13780]: Jan 11 04:17:28 Reply from node 200070a: 0 bytes CLVMD[d6c13780]: Jan 11 04:17:28 Got 2 replies, expecting: 2 CLVMD[41dba950]: Jan 11 04:17:28 Got post command condition... CLVMD[41dba950]: Jan 11 04:17:28 Waiting for next pre command CLVMD[d6c13780]: Jan 11 04:17:28 read on PIPE 8: 4 bytes: status: 0 CLVMD[d6c13780]: Jan 11 04:17:28 background routine status was 0, sock_client=0x7f71d00008c0 CLVMD[d6c13780]: Jan 11 04:17:28 Send local reply >> At this point, both clvmd processes are hung >> As are the lvcreates >> The lvcreates are both non-interruptable >> I'll try sending a SIGINT to the clvmds. This one first CLVMD[d6c13780]: Jan 11 04:19:11 SIGTERM received CLVMD[d6c13780]: Jan 11 04:19:44 SIGTERM received CLVMD[d6c13780]: Jan 11 04:19:54 SIGTERM received >> The only way to kill them is SIGKILL Killed