CLVMD[cee0f780]: Jan 23 12:30:38 CLVMD started CLVMD[cee0f780]: Jan 23 12:30:38 Our local node id is 16779018 CLVMD[cee0f780]: Jan 23 12:30:38 Add_internal_client, fd = 5 CLVMD[cee0f780]: Jan 23 12:30:38 Connected to OpenAIS CLVMD[cee0f780]: Jan 23 12:30:38 Cluster ready, doing some more initialisation CLVMD[cee0f780]: Jan 23 12:30:38 starting LVM thread CLVMD[41495950]: Jan 23 12:30:38 LVM thread function started CLVMD[cee0f780]: Jan 23 12:30:38 clvmd ready for work CLVMD[cee0f780]: Jan 23 12:30:38 Using timeout of 60 seconds CLVMD[cee0f780]: Jan 23 12:30:38 confchg callback. 1 joined, 0 left, 1 members File descriptor 4 (socket:[2258846]) leaked on lvm invocation. Parent PID 3514: sh WARNING: Locking disabled. Be careful! This could corrupt your metadata. CLVMD[41495950]: Jan 23 12:30:38 LVM thread waiting for work CLVMD[cee0f780]: Jan 23 12:30:43 confchg callback. 1 joined, 0 left, 2 members CLVMD[cee0f780]: Jan 23 12:30:49 Got new connection on fd 7 CLVMD[cee0f780]: Jan 23 12:30:49 Read on local socket 7, len = 28 CLVMD[cee0f780]: Jan 23 12:30:49 creating pipe, [8, 9] CLVMD[cee0f780]: Jan 23 12:30:49 Creating pre&post thread CLVMD[41c96950]: Jan 23 12:30:49 in sub thread: client = 0x69f0d0 CLVMD[41c96950]: Jan 23 12:30:49 Sub thread ready for work. CLVMD[41c96950]: Jan 23 12:30:49 doing PRE command LOCK_VG 'V_xenvg' at 1 (client=0x69f0d0) CLVMD[41c96950]: Jan 23 12:30:49 lock_resource 'V_xenvg-1', flags=0, mode=1 CLVMD[cee0f780]: Jan 23 12:30:49 Created pre&post thread, state = 0 CLVMD[41c96950]: Jan 23 12:30:49 lock_resource returning 1, lock_id=625558ec00000000 CLVMD[41c96950]: Jan 23 12:30:49 unlock_resource V_xenvg-2 CLVMD[41c96950]: Jan 23 12:30:49 Writing status 0 down pipe 9 CLVMD[41c96950]: Jan 23 12:30:49 Waiting to do post command - state = 0 CLVMD[cee0f780]: Jan 23 12:30:49 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:30:49 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:30:49 distribute command: XID = 0 CLVMD[cee0f780]: Jan 23 12:30:49 add_to_lvmqueue: cmd=0x69f890. client=0x69f0d0, msg=0x69f1e0, len=28, csid=(nil), xid=0 CLVMD[41495950]: Jan 23 12:30:49 process_work_item: local CLVMD[41495950]: Jan 23 12:30:49 process_local_command: LOCK_VG (0x33) msg=0x69f8d0, msglen =28, client=0x69f0d0 CLVMD[41495950]: Jan 23 12:30:49 Dropping metadata for VG xenvg CLVMD[41495950]: Jan 23 12:30:49 Reply from node 100070a: 0 bytes CLVMD[41495950]: Jan 23 12:30:49 Got 1 replies, expecting: 1 CLVMD[41495950]: Jan 23 12:30:49 LVM thread waiting for work CLVMD[41c96950]: Jan 23 12:30:49 Got post command condition... CLVMD[41c96950]: Jan 23 12:30:49 Waiting for next pre command CLVMD[cee0f780]: Jan 23 12:30:49 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:30:49 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:30:49 Send local reply CLVMD[cee0f780]: Jan 23 12:30:49 Read on local socket 7, len = 28 CLVMD[41c96950]: Jan 23 12:30:49 Got pre command condition... CLVMD[41c96950]: Jan 23 12:30:49 doing PRE command LOCK_VG 'V_xenvg' at 6 (client=0x69f0d0) CLVMD[41c96950]: Jan 23 12:30:49 unlock_resource V_xenvg-1 CLVMD[41c96950]: Jan 23 12:30:49 unlock_resource: lockid: 625558ec00000000 CLVMD[41c96950]: Jan 23 12:30:49 unlock_resource V_xenvg-2 CLVMD[41c96950]: Jan 23 12:30:49 Writing status 0 down pipe 9 CLVMD[41c96950]: Jan 23 12:30:49 Waiting to do post command - state = 0 CLVMD[cee0f780]: Jan 23 12:30:49 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:30:49 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:30:49 distribute command: XID = 1 CLVMD[cee0f780]: Jan 23 12:30:49 add_to_lvmqueue: cmd=0x67c970. client=0x69f0d0, msg=0x69f1e0, len=28, csid=(nil), xid=1 CLVMD[41495950]: Jan 23 12:30:49 process_work_item: local CLVMD[41495950]: Jan 23 12:30:49 process_local_command: LOCK_VG (0x33) msg=0x69f860, msglen =28, client=0x69f0d0 CLVMD[41495950]: Jan 23 12:30:49 Dropping metadata for VG xenvg CLVMD[41495950]: Jan 23 12:30:49 Reply from node 100070a: 0 bytes CLVMD[41495950]: Jan 23 12:30:49 Got 1 replies, expecting: 1 CLVMD[41c96950]: Jan 23 12:30:49 Got post command condition... CLVMD[41495950]: Jan 23 12:30:49 LVM thread waiting for work CLVMD[41c96950]: Jan 23 12:30:49 Waiting for next pre command CLVMD[cee0f780]: Jan 23 12:30:49 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:30:49 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:30:49 Send local reply CLVMD[cee0f780]: Jan 23 12:30:49 Read on local socket 7, len = 0 CLVMD[cee0f780]: Jan 23 12:30:49 EOF on local socket: inprogress=0 CLVMD[cee0f780]: Jan 23 12:30:49 Waiting for child thread CLVMD[41c96950]: Jan 23 12:30:49 Got pre command condition... CLVMD[41c96950]: Jan 23 12:30:49 Subthread finished CLVMD[cee0f780]: Jan 23 12:30:49 Joined child thread CLVMD[cee0f780]: Jan 23 12:30:49 ret == 0, errno = 111. removing client CLVMD[cee0f780]: Jan 23 12:30:49 add_to_lvmqueue: cmd=0x69f210. client=0x69f0d0, msg=(nil), len=0, csid=(nil), xid=1 CLVMD[41495950]: Jan 23 12:30:49 process_work_item: free fd 7 CLVMD[41495950]: Jan 23 12:30:49 LVM thread waiting for work CLVMD[cee0f780]: Jan 23 12:31:01 Got new connection on fd 7 CLVMD[cee0f780]: Jan 23 12:31:01 Read on local socket 7, len = 28 CLVMD[cee0f780]: Jan 23 12:31:01 creating pipe, [8, 9] CLVMD[cee0f780]: Jan 23 12:31:01 Creating pre&post thread CLVMD[41c96950]: Jan 23 12:31:01 in sub thread: client = 0x69f0d0 CLVMD[41c96950]: Jan 23 12:31:01 Sub thread ready for work. CLVMD[41c96950]: Jan 23 12:31:01 doing PRE command LOCK_VG 'V_xenvg' at 4 (client=0x69f0d0) CLVMD[41c96950]: Jan 23 12:31:01 lock_resource 'V_xenvg-2', flags=0, mode=2 CLVMD[cee0f780]: Jan 23 12:31:01 Created pre&post thread, state = 0 CLVMD[41c96950]: Jan 23 12:31:01 lock_resource returning 1, lock_id=3d1b58ba00000000 CLVMD[41c96950]: Jan 23 12:31:01 unlock_resource V_xenvg-1 CLVMD[41c96950]: Jan 23 12:31:01 Writing status 0 down pipe 9 CLVMD[41c96950]: Jan 23 12:31:01 Waiting to do post command - state = 0 CLVMD[cee0f780]: Jan 23 12:31:01 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:01 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:01 distribute command: XID = 2 CLVMD[cee0f780]: Jan 23 12:31:01 add_to_lvmqueue: cmd=0x69f210. client=0x69f0d0, msg=0x69f1e0, len=28, csid=(nil), xid=2 CLVMD[41495950]: Jan 23 12:31:01 process_work_item: local CLVMD[41495950]: Jan 23 12:31:01 process_local_command: LOCK_VG (0x33) msg=0x69f2b0, msglen =28, client=0x69f0d0 CLVMD[41495950]: Jan 23 12:31:01 Dropping metadata for VG xenvg CLVMD[41495950]: Jan 23 12:31:01 Reply from node 100070a: 0 bytes CLVMD[41495950]: Jan 23 12:31:01 Got 1 replies, expecting: 1 CLVMD[41495950]: Jan 23 12:31:01 LVM thread waiting for work CLVMD[41c96950]: Jan 23 12:31:01 Got post command condition... CLVMD[41c96950]: Jan 23 12:31:01 Waiting for next pre command CLVMD[cee0f780]: Jan 23 12:31:01 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:01 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:01 Send local reply CLVMD[cee0f780]: Jan 23 12:31:01 Read on local socket 7, len = 28 CLVMD[cee0f780]: Jan 23 12:31:01 check_all_clvmds_running CLVMD[cee0f780]: Jan 23 12:31:01 down_callback. node 16779018, state = 3 CLVMD[cee0f780]: Jan 23 12:31:01 down_callback. node 33556234, state = 3 CLVMD[41c96950]: Jan 23 12:31:01 Got pre command condition... CLVMD[41c96950]: Jan 23 12:31:01 Writing status 0 down pipe 9 CLVMD[41c96950]: Jan 23 12:31:01 Waiting to do post command - state = 0 CLVMD[cee0f780]: Jan 23 12:31:01 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:01 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:01 distribute command: XID = 3 CLVMD[cee0f780]: Jan 23 12:31:01 num_nodes = 2 CLVMD[cee0f780]: Jan 23 12:31:01 add_to_lvmqueue: cmd=0x69f2e0. client=0x69f0d0, msg=0x69f1e0, len=28, csid=(nil), xid=3 CLVMD[cee0f780]: Jan 23 12:31:01 CLVMD[41495950]: Jan 23 12:31:01 process_work_item: local Sending message to all cluster nodes CLVMD[41495950]: Jan 23 12:31:01 process_local_command: LOCK_VG (0x33) msg=0x69f2b0, msglen =28, client=0x69f0d0 CLVMD[41495950]: Jan 23 12:31:01 Dropping metadata for VG xenvg CLVMD[41495950]: Jan 23 12:31:01 Reply from node 100070a: 0 bytes CLVMD[41495950]: Jan 23 12:31:01 Got 1 replies, expecting: 2 CLVMD[41495950]: Jan 23 12:31:01 LVM thread waiting for work CLVMD[cee0f780]: Jan 23 12:31:01 16779018 got message from nodeid 16779018 for 0. len 28 CLVMD[cee0f780]: Jan 23 12:31:01 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[cee0f780]: Jan 23 12:31:01 Reply from node 200070a: 0 bytes CLVMD[cee0f780]: Jan 23 12:31:01 Got 2 replies, expecting: 2 CLVMD[41c96950]: Jan 23 12:31:01 Got post command condition... CLVMD[41c96950]: Jan 23 12:31:01 Waiting for next pre command CLVMD[cee0f780]: Jan 23 12:31:01 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:01 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:01 Send local reply CLVMD[cee0f780]: Jan 23 12:31:01 Read on local socket 7, len = 28 CLVMD[cee0f780]: Jan 23 12:31:01 check_all_clvmds_running CLVMD[cee0f780]: Jan 23 12:31:01 down_callback. node 16779018, state = 3 CLVMD[cee0f780]: Jan 23 12:31:01 down_callback. node 33556234, state = 3 CLVMD[41c96950]: Jan 23 12:31:01 Got pre command condition... CLVMD[41c96950]: Jan 23 12:31:01 Writing status 0 down pipe 9 CLVMD[41c96950]: Jan 23 12:31:01 Waiting to do post command - state = 0 CLVMD[cee0f780]: Jan 23 12:31:01 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:01 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:01 distribute command: XID = 4 CLVMD[cee0f780]: Jan 23 12:31:01 num_nodes = 2 CLVMD[cee0f780]: Jan 23 12:31:01 add_to_lvmqueue: cmd=0x69f2e0. client=0x69f0d0, msg=0x69f1e0, len=28, csid=(nil), xid=4 CLVMD[cee0f780]: Jan 23 12:31:01 Sending message to all cluster nodes CLVMD[41495950]: Jan 23 12:31:01 process_work_item: local CLVMD[41495950]: Jan 23 12:31:01 process_local_command: LOCK_VG (0x33) msg=0x69f2b0, msglen =28, client=0x69f0d0 CLVMD[41495950]: Jan 23 12:31:01 Dropping metadata for VG xenvg CLVMD[41495950]: Jan 23 12:31:01 Reply from node 100070a: 0 bytes CLVMD[41495950]: Jan 23 12:31:01 Got 1 replies, expecting: 2 CLVMD[41495950]: Jan 23 12:31:01 LVM thread waiting for work CLVMD[cee0f780]: Jan 23 12:31:01 16779018 got message from nodeid 16779018 for 0. len 28 CLVMD[cee0f780]: Jan 23 12:31:01 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[cee0f780]: Jan 23 12:31:01 Reply from node 200070a: 0 bytes CLVMD[cee0f780]: Jan 23 12:31:01 Got 2 replies, expecting: 2 CLVMD[41c96950]: Jan 23 12:31:01 Got post command condition... CLVMD[41c96950]: Jan 23 12:31:01 Waiting for next pre command CLVMD[cee0f780]: Jan 23 12:31:01 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:01 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:01 Send local reply CLVMD[cee0f780]: Jan 23 12:31:01 Read on local socket 7, len = 85 CLVMD[cee0f780]: Jan 23 12:31:01 check_all_clvmds_running CLVMD[cee0f780]: Jan 23 12:31:01 down_callback. node 16779018, state = 3 CLVMD[cee0f780]: Jan 23 12:31:01 down_callback. node 33556234, state = 3 CLVMD[41c96950]: Jan 23 12:31:01 Got pre command condition... CLVMD[41c96950]: Jan 23 12:31:01 Writing status 0 down pipe 9 CLVMD[41c96950]: Jan 23 12:31:01 Waiting to do post command - state = 0 CLVMD[cee0f780]: Jan 23 12:31:01 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:01 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:01 distribute command: XID = 5 CLVMD[cee0f780]: Jan 23 12:31:01 num_nodes = 2 CLVMD[cee0f780]: Jan 23 12:31:01 add_to_lvmqueue: cmd=0x69f2e0. client=0x69f0d0, msg=0x69ff70, len=85, csid=(nil), xid=5 CLVMD[cee0f780]: Jan 23 12:31:01 Sending message to all cluster nodes CLVMD[41495950]: Jan 23 12:31:01 process_work_item: local CLVMD[41495950]: Jan 23 12:31:01 process_local_command: LOCK_LV (0x32) msg=0x69ffd0, msglen =85, client=0x69f0d0 CLVMD[41495950]: Jan 23 12:31:01 do_lock_lv: resource 'XgQ3JnQrCyhGWBoDqpXzYsyN1frLCaXWFNK3LlaFUObdfqVpSApR89aOBAczYejc', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[cee0f780]: Jan 23 12:31:01 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[41495950]: Jan 23 12:31:01 lock_resource 'XgQ3JnQrCyhGWBoDqpXzYsyN1frLCaXWFNK3LlaFUObdfqVpSApR89aOBAczYejc-1', flags=1, mode=1 CLVMD[41495950]: Jan 23 12:31:01 lock_resource returning 1, lock_id=41b71efb00000001 CLVMD[41495950]: Jan 23 12:31:01 unlock_resource XgQ3JnQrCyhGWBoDqpXzYsyN1frLCaXWFNK3LlaFUObdfqVpSApR89aOBAczYejc-2 CLVMD[41495950]: Jan 23 12:31:01 Command return is 0 CLVMD[41495950]: Jan 23 12:31:01 Reply from node 100070a: 0 bytes CLVMD[41495950]: Jan 23 12:31:01 Got 1 replies, expecting: 2 CLVMD[41495950]: Jan 23 12:31:01 LVM thread waiting for work CLVMD[cee0f780]: Jan 23 12:31:01 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[cee0f780]: Jan 23 12:31:01 Reply from node 200070a: 0 bytes CLVMD[cee0f780]: Jan 23 12:31:01 Got 2 replies, expecting: 2 CLVMD[41c96950]: Jan 23 12:31:01 Got post command condition... CLVMD[41c96950]: Jan 23 12:31:01 Waiting for next pre command CLVMD[cee0f780]: Jan 23 12:31:01 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:01 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:01 Send local reply CLVMD[cee0f780]: Jan 23 12:31:01 Read on local socket 7, len = 28 CLVMD[cee0f780]: Jan 23 12:31:01 check_all_clvmds_running CLVMD[cee0f780]: Jan 23 12:31:01 down_callback. node 16779018, state = 3 CLVMD[cee0f780]: Jan 23 12:31:01 down_callback. node 33556234, state = 3 CLVMD[41c96950]: Jan 23 12:31:01 Got pre command condition... CLVMD[41c96950]: Jan 23 12:31:01 Writing status 0 down pipe 9 CLVMD[41c96950]: Jan 23 12:31:01 Waiting to do post command - state = 0 CLVMD[cee0f780]: Jan 23 12:31:01 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:01 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:01 distribute command: XID = 6 CLVMD[cee0f780]: Jan 23 12:31:01 num_nodes = 2 CLVMD[cee0f780]: Jan 23 12:31:01 add_to_lvmqueue: cmd=0x7a9700. client=0x69f0d0, msg=0x69f2e0, len=28, csid=(nil), xid=6 CLVMD[cee0f780]: Jan 23 12:31:01 Sending message to all cluster nodes CLVMD[41495950]: Jan 23 12:31:01 process_work_item: local CLVMD[41495950]: Jan 23 12:31:01 process_local_command: LOCK_VG (0x33) msg=0x7a9740, msglen =28, client=0x69f0d0 CLVMD[41495950]: Jan 23 12:31:01 Dropping metadata for VG xenvg CLVMD[cee0f780]: Jan 23 12:31:01 16779018 got message from nodeid 16779018 for 0. len 28 CLVMD[41495950]: Jan 23 12:31:01 Reply from node 100070a: 0 bytes CLVMD[41495950]: Jan 23 12:31:01 Got 1 replies, expecting: 2 CLVMD[41495950]: Jan 23 12:31:01 LVM thread waiting for work CLVMD[cee0f780]: Jan 23 12:31:01 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[cee0f780]: Jan 23 12:31:01 Reply from node 200070a: 0 bytes CLVMD[cee0f780]: Jan 23 12:31:01 Got 2 replies, expecting: 2 CLVMD[41c96950]: Jan 23 12:31:01 Got post command condition... CLVMD[41c96950]: Jan 23 12:31:01 Waiting for next pre command CLVMD[cee0f780]: Jan 23 12:31:01 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:01 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:01 Send local reply CLVMD[cee0f780]: Jan 23 12:31:01 Read on local socket 7, len = 28 CLVMD[41c96950]: Jan 23 12:31:01 Got pre command condition... CLVMD[41c96950]: Jan 23 12:31:01 doing PRE command LOCK_VG 'V_xenvg' at 6 (client=0x69f0d0) CLVMD[41c96950]: Jan 23 12:31:01 unlock_resource V_xenvg-1 CLVMD[41c96950]: Jan 23 12:31:01 unlock_resource V_xenvg-2 CLVMD[41c96950]: Jan 23 12:31:01 unlock_resource: lockid: 3d1b58ba00000000 CLVMD[41c96950]: Jan 23 12:31:01 Writing status 0 down pipe 9 CLVMD[41c96950]: Jan 23 12:31:01 Waiting to do post command - state = 0 CLVMD[cee0f780]: Jan 23 12:31:01 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:01 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:01 distribute command: XID = 7 CLVMD[cee0f780]: Jan 23 12:31:01 add_to_lvmqueue: cmd=0x69f2e0. client=0x69f0d0, msg=0x7a9740, len=28, csid=(nil), xid=7 CLVMD[41495950]: Jan 23 12:31:01 process_work_item: local CLVMD[41495950]: Jan 23 12:31:01 process_local_command: LOCK_VG (0x33) msg=0x69f280, msglen =28, client=0x69f0d0 CLVMD[41495950]: Jan 23 12:31:01 Dropping metadata for VG xenvg CLVMD[41495950]: Jan 23 12:31:01 Reply from node 100070a: 0 bytes CLVMD[41495950]: Jan 23 12:31:01 Got 1 replies, expecting: 1 CLVMD[41495950]: Jan 23 12:31:01 LVM thread waiting for work CLVMD[41c96950]: Jan 23 12:31:01 Got post command condition... CLVMD[41c96950]: Jan 23 12:31:01 Waiting for next pre command CLVMD[cee0f780]: Jan 23 12:31:01 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:01 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:01 Send local reply CLVMD[cee0f780]: Jan 23 12:31:01 Read on local socket 7, len = 0 CLVMD[cee0f780]: Jan 23 12:31:01 EOF on local socket: inprogress=0 CLVMD[cee0f780]: Jan 23 12:31:01 Waiting for child thread CLVMD[41c96950]: Jan 23 12:31:01 Got pre command condition... CLVMD[41c96950]: Jan 23 12:31:01 Subthread finished CLVMD[cee0f780]: Jan 23 12:31:01 Joined child thread CLVMD[cee0f780]: Jan 23 12:31:01 ret == 0, errno = 9. removing client CLVMD[cee0f780]: Jan 23 12:31:01 add_to_lvmqueue: cmd=0x69f2e0. client=0x69f0d0, msg=(nil), len=0, csid=(nil), xid=7 CLVMD[41495950]: Jan 23 12:31:01 process_work_item: free fd 7 CLVMD[41495950]: Jan 23 12:31:01 LVM thread waiting for work CLVMD[cee0f780]: Jan 23 12:31:09 Got new connection on fd 7 CLVMD[cee0f780]: Jan 23 12:31:09 Read on local socket 7, len = 28 CLVMD[cee0f780]: Jan 23 12:31:09 creating pipe, [8, 9] CLVMD[cee0f780]: Jan 23 12:31:09 Creating pre&post thread CLVMD[41c96950]: Jan 23 12:31:09 in sub thread: client = 0x69f0d0 CLVMD[41c96950]: Jan 23 12:31:09 Sub thread ready for work. CLVMD[41c96950]: Jan 23 12:31:09 doing PRE command LOCK_VG 'V_xenvg' at 1 (client=0x69f0d0) CLVMD[41c96950]: Jan 23 12:31:09 lock_resource 'V_xenvg-1', flags=0, mode=1 CLVMD[cee0f780]: Jan 23 12:31:09 Created pre&post thread, state = 0 CLVMD[41c96950]: Jan 23 12:31:09 lock_resource returning 1, lock_id=515f007c00000000 CLVMD[41c96950]: Jan 23 12:31:09 unlock_resource V_xenvg-2 CLVMD[41c96950]: Jan 23 12:31:09 Writing status 0 down pipe 9 CLVMD[41c96950]: Jan 23 12:31:09 Waiting to do post command - state = 0 CLVMD[cee0f780]: Jan 23 12:31:09 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:09 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:09 distribute command: XID = 8 CLVMD[cee0f780]: Jan 23 12:31:09 add_to_lvmqueue: cmd=0x69f2e0. client=0x69f0d0, msg=0x7a9740, len=28, csid=(nil), xid=8 CLVMD[41495950]: Jan 23 12:31:09 process_work_item: local CLVMD[41495950]: Jan 23 12:31:09 process_local_command: LOCK_VG (0x33) msg=0x7a9700, msglen =28, client=0x69f0d0 CLVMD[41495950]: Jan 23 12:31:09 Dropping metadata for VG xenvg CLVMD[41495950]: Jan 23 12:31:09 Reply from node 100070a: 0 bytes CLVMD[41495950]: Jan 23 12:31:09 Got 1 replies, expecting: 1 CLVMD[41c96950]: Jan 23 12:31:09 Got post command condition... CLVMD[41c96950]: Jan 23 12:31:09 Waiting for next pre command CLVMD[41495950]: Jan 23 12:31:09 LVM thread waiting for work CLVMD[cee0f780]: Jan 23 12:31:09 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:09 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:09 Send local reply CLVMD[cee0f780]: Jan 23 12:31:09 Read on local socket 7, len = 28 CLVMD[41c96950]: Jan 23 12:31:09 Got pre command condition... CLVMD[41c96950]: Jan 23 12:31:09 doing PRE command LOCK_VG 'V_xenvg' at 6 (client=0x69f0d0) CLVMD[41c96950]: Jan 23 12:31:09 unlock_resource V_xenvg-1 CLVMD[41c96950]: Jan 23 12:31:09 unlock_resource: lockid: 515f007c00000000 CLVMD[41c96950]: Jan 23 12:31:09 unlock_resource V_xenvg-2 CLVMD[41c96950]: Jan 23 12:31:09 Writing status 0 down pipe 9 CLVMD[41c96950]: Jan 23 12:31:09 Waiting to do post command - state = 0 CLVMD[cee0f780]: Jan 23 12:31:09 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:09 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:09 distribute command: XID = 9 CLVMD[cee0f780]: Jan 23 12:31:09 add_to_lvmqueue: cmd=0x69f2e0. client=0x69f0d0, msg=0x7a9740, len=28, csid=(nil), xid=9 CLVMD[41495950]: Jan 23 12:31:09 process_work_item: local CLVMD[41495950]: Jan 23 12:31:09 process_local_command: LOCK_VG (0x33) msg=0x69f250, msglen =28, client=0x69f0d0 CLVMD[41495950]: Jan 23 12:31:09 Dropping metadata for VG xenvg CLVMD[41495950]: Jan 23 12:31:09 Reply from node 100070a: 0 bytes CLVMD[41495950]: Jan 23 12:31:09 Got 1 replies, expecting: 1 CLVMD[41c96950]: Jan 23 12:31:09 Got post command condition... CLVMD[41c96950]: Jan 23 12:31:09 Waiting for next pre command CLVMD[41495950]: Jan 23 12:31:09 LVM thread waiting for work CLVMD[cee0f780]: Jan 23 12:31:09 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:09 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:09 Send local reply CLVMD[cee0f780]: Jan 23 12:31:09 Read on local socket 7, len = 33 CLVMD[41c96950]: Jan 23 12:31:09 Got pre command condition... CLVMD[41c96950]: Jan 23 12:31:09 doing PRE command LOCK_VG 'V_black-mesa' at 1 (client=0x69f0d0) CLVMD[41c96950]: Jan 23 12:31:09 lock_resource 'V_black-mesa-1', flags=0, mode=1 CLVMD[41c96950]: Jan 23 12:31:09 lock_resource returning 1, lock_id=4db127f800000000 CLVMD[41c96950]: Jan 23 12:31:09 unlock_resource V_black-mesa-2 CLVMD[41c96950]: Jan 23 12:31:09 Writing status 0 down pipe 9 CLVMD[41c96950]: Jan 23 12:31:09 Waiting to do post command - state = 0 CLVMD[cee0f780]: Jan 23 12:31:09 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:09 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:09 distribute command: XID = 10 CLVMD[cee0f780]: Jan 23 12:31:09 add_to_lvmqueue: cmd=0x69f2e0. client=0x69f0d0, msg=0x7a9740, len=33, csid=(nil), xid=10 CLVMD[41495950]: Jan 23 12:31:09 process_work_item: local CLVMD[41495950]: Jan 23 12:31:09 process_local_command: LOCK_VG (0x33) msg=0x7a9700, msglen =33, client=0x69f0d0 CLVMD[41495950]: Jan 23 12:31:09 Dropping metadata for VG black-mesa CLVMD[41495950]: Jan 23 12:31:09 Reply from node 100070a: 0 bytes CLVMD[41495950]: Jan 23 12:31:09 Got 1 replies, expecting: 1 CLVMD[41c96950]: Jan 23 12:31:09 Got post command condition... CLVMD[41c96950]: Jan 23 12:31:09 Waiting for next pre command CLVMD[41495950]: Jan 23 12:31:09 LVM thread waiting for work CLVMD[cee0f780]: Jan 23 12:31:09 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:09 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:09 Send local reply CLVMD[cee0f780]: Jan 23 12:31:09 Read on local socket 7, len = 33 CLVMD[41c96950]: Jan 23 12:31:09 Got pre command condition... CLVMD[41c96950]: Jan 23 12:31:09 doing PRE command LOCK_VG 'V_black-mesa' at 6 (client=0x69f0d0) CLVMD[41c96950]: Jan 23 12:31:09 unlock_resource V_black-mesa-1 CLVMD[41c96950]: Jan 23 12:31:09 unlock_resource: lockid: 4db127f800000000 CLVMD[41c96950]: Jan 23 12:31:09 unlock_resource V_black-mesa-2 CLVMD[41c96950]: Jan 23 12:31:09 Writing status 0 down pipe 9 CLVMD[41c96950]: Jan 23 12:31:09 Waiting to do post command - state = 0 CLVMD[cee0f780]: Jan 23 12:31:09 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:09 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:09 distribute command: XID = 11 CLVMD[cee0f780]: Jan 23 12:31:09 add_to_lvmqueue: cmd=0x69f2e0. client=0x69f0d0, msg=0x7a9740, len=33, csid=(nil), xid=11 CLVMD[41495950]: Jan 23 12:31:09 process_work_item: local CLVMD[41495950]: Jan 23 12:31:09 process_local_command: LOCK_VG (0x33) msg=0x69f280, msglen =33, client=0x69f0d0 CLVMD[41495950]: Jan 23 12:31:09 Dropping metadata for VG black-mesa CLVMD[41495950]: Jan 23 12:31:09 Reply from node 100070a: 0 bytes CLVMD[41495950]: Jan 23 12:31:09 Got 1 replies, expecting: 1 CLVMD[41c96950]: Jan 23 12:31:09 Got post command condition... CLVMD[41c96950]: Jan 23 12:31:09 Waiting for next pre command CLVMD[41495950]: Jan 23 12:31:09 LVM thread waiting for work CLVMD[cee0f780]: Jan 23 12:31:09 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:09 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:09 Send local reply CLVMD[cee0f780]: Jan 23 12:31:09 Read on local socket 7, len = 0 CLVMD[cee0f780]: Jan 23 12:31:09 EOF on local socket: inprogress=0 CLVMD[cee0f780]: Jan 23 12:31:09 Waiting for child thread CLVMD[41c96950]: Jan 23 12:31:09 Got pre command condition... CLVMD[41c96950]: Jan 23 12:31:09 Subthread finished CLVMD[cee0f780]: Jan 23 12:31:09 Joined child thread CLVMD[cee0f780]: Jan 23 12:31:09 ret == 0, errno = 9. removing client CLVMD[cee0f780]: Jan 23 12:31:09 add_to_lvmqueue: cmd=0x69f2e0. client=0x69f0d0, msg=(nil), len=0, csid=(nil), xid=11 CLVMD[41495950]: Jan 23 12:31:09 process_work_item: free fd 7 CLVMD[41495950]: Jan 23 12:31:09 LVM thread waiting for work CLVMD[cee0f780]: Jan 23 12:31:11 Got new connection on fd 7 CLVMD[cee0f780]: Jan 23 12:31:11 Read on local socket 7, len = 28 CLVMD[cee0f780]: Jan 23 12:31:11 creating pipe, [8, 9] CLVMD[cee0f780]: Jan 23 12:31:11 Creating pre&post thread CLVMD[41c96950]: Jan 23 12:31:11 in sub thread: client = 0x69f0d0 CLVMD[41c96950]: Jan 23 12:31:11 Sub thread ready for work. CLVMD[41c96950]: Jan 23 12:31:11 doing PRE command LOCK_VG 'V_xenvg' at 4 (client=0x69f0d0) CLVMD[41c96950]: Jan 23 12:31:11 lock_resource 'V_xenvg-2', flags=0, mode=2 CLVMD[cee0f780]: Jan 23 12:31:11 Created pre&post thread, state = 0 CLVMD[41c96950]: Jan 23 12:31:11 lock_resource returning 1, lock_id=1190cde700000000 CLVMD[41c96950]: Jan 23 12:31:11 unlock_resource V_xenvg-1 CLVMD[41c96950]: Jan 23 12:31:11 Writing status 0 down pipe 9 CLVMD[41c96950]: Jan 23 12:31:11 Waiting to do post command - state = 0 CLVMD[cee0f780]: Jan 23 12:31:11 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:11 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:11 distribute command: XID = 12 CLVMD[cee0f780]: Jan 23 12:31:11 add_to_lvmqueue: cmd=0x69f2e0. client=0x69f0d0, msg=0x7a9740, len=28, csid=(nil), xid=12 CLVMD[41495950]: Jan 23 12:31:11 process_work_item: local CLVMD[41495950]: Jan 23 12:31:11 process_local_command: LOCK_VG (0x33) msg=0x7a9700, msglen =28, client=0x69f0d0 CLVMD[41495950]: Jan 23 12:31:11 Dropping metadata for VG xenvg CLVMD[41495950]: Jan 23 12:31:11 Reply from node 100070a: 0 bytes CLVMD[41495950]: Jan 23 12:31:11 Got 1 replies, expecting: 1 CLVMD[41495950]: Jan 23 12:31:11 LVM thread waiting for work CLVMD[41c96950]: Jan 23 12:31:11 Got post command condition... CLVMD[41c96950]: Jan 23 12:31:11 Waiting for next pre command CLVMD[cee0f780]: Jan 23 12:31:11 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:11 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:11 Send local reply CLVMD[cee0f780]: Jan 23 12:31:11 Read on local socket 7, len = 85 CLVMD[cee0f780]: Jan 23 12:31:11 check_all_clvmds_running CLVMD[cee0f780]: Jan 23 12:31:11 down_callback. node 16779018, state = 3 CLVMD[cee0f780]: Jan 23 12:31:11 down_callback. node 33556234, state = 3 CLVMD[41c96950]: Jan 23 12:31:11 Got pre command condition... CLVMD[41c96950]: Jan 23 12:31:11 Writing status 0 down pipe 9 CLVMD[41c96950]: Jan 23 12:31:11 Waiting to do post command - state = 0 CLVMD[cee0f780]: Jan 23 12:31:11 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:11 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:11 distribute command: XID = 13 CLVMD[cee0f780]: Jan 23 12:31:11 num_nodes = 2 CLVMD[cee0f780]: Jan 23 12:31:11 add_to_lvmqueue: cmd=0x69f2e0. client=0x69f0d0, msg=0x7a9880, len=85, csid=(nil), xid=13 CLVMD[cee0f780]: Jan 23 12:31:11 Sending message to all cluster nodes CLVMD[41495950]: Jan 23 12:31:11 process_work_item: local CLVMD[41495950]: Jan 23 12:31:11 process_local_command: LOCK_LV (0x32) msg=0x7a1d10, msglen =85, client=0x69f0d0 CLVMD[41495950]: Jan 23 12:31:11 do_lock_lv: resource 'XgQ3JnQrCyhGWBoDqpXzYsyN1frLCaXWFNK3LlaFUObdfqVpSApR89aOBAczYejc', cmd = 0x18 LCK_LV_DEACTIVATE (NULL|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[cee0f780]: Jan 23 12:31:11 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[cee0f780]: Jan 23 12:31:11 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[cee0f780]: Jan 23 12:31:11 Reply from node 200070a: 0 bytes CLVMD[cee0f780]: Jan 23 12:31:11 Got 1 replies, expecting: 2 CLVMD[41495950]: Jan 23 12:31:11 unlock_resource XgQ3JnQrCyhGWBoDqpXzYsyN1frLCaXWFNK3LlaFUObdfqVpSApR89aOBAczYejc-1 CLVMD[41495950]: Jan 23 12:31:11 unlock_resource: lockid: 41b71efb00000001 CLVMD[41495950]: Jan 23 12:31:11 unlock_resource XgQ3JnQrCyhGWBoDqpXzYsyN1frLCaXWFNK3LlaFUObdfqVpSApR89aOBAczYejc-2 CLVMD[41495950]: Jan 23 12:31:11 Command return is 0 CLVMD[41495950]: Jan 23 12:31:11 Reply from node 100070a: 0 bytes CLVMD[41495950]: Jan 23 12:31:11 Got 2 replies, expecting: 2 CLVMD[41495950]: Jan 23 12:31:11 LVM thread waiting for work CLVMD[41c96950]: Jan 23 12:31:11 Got post command condition... CLVMD[41c96950]: Jan 23 12:31:11 Waiting for next pre command CLVMD[cee0f780]: Jan 23 12:31:11 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:11 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:11 Send local reply CLVMD[cee0f780]: Jan 23 12:31:11 Read on local socket 7, len = 85 CLVMD[cee0f780]: Jan 23 12:31:11 check_all_clvmds_running CLVMD[cee0f780]: Jan 23 12:31:11 down_callback. node 16779018, state = 3 CLVMD[cee0f780]: Jan 23 12:31:11 down_callback. node 33556234, state = 3 CLVMD[41c96950]: Jan 23 12:31:11 Got pre command condition... CLVMD[41c96950]: Jan 23 12:31:11 Writing status 0 down pipe 9 CLVMD[41c96950]: Jan 23 12:31:11 Waiting to do post command - state = 0 CLVMD[cee0f780]: Jan 23 12:31:11 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:11 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:11 distribute command: XID = 14 CLVMD[cee0f780]: Jan 23 12:31:11 num_nodes = 2 CLVMD[cee0f780]: Jan 23 12:31:11 add_to_lvmqueue: cmd=0x69f2e0. client=0x69f0d0, msg=0x7a9880, len=85, csid=(nil), xid=14 CLVMD[cee0f780]: Jan 23 12:31:11 Sending message to all cluster nodes CLVMD[41495950]: Jan 23 12:31:11 process_work_item: local CLVMD[41495950]: Jan 23 12:31:11 process_local_command: LOCK_LV (0x32) msg=0x7a15b0, msglen =85, client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:11 16779018 got message from nodeid 16779018 for 0. len 85 CLVMD[41495950]: Jan 23 12:31:11 do_lock_lv: resource 'XgQ3JnQrCyhGWBoDqpXzYsyN1frLCaXWFNK3LlaFUObdfqVpSApR89aOBAczYejc', cmd = 0x1e LCK_LV_RESUME (UNLOCK|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[41495950]: Jan 23 12:31:11 do_resume_lv, lock not already held CLVMD[41495950]: Jan 23 12:31:11 Command return is 0 CLVMD[41495950]: Jan 23 12:31:11 Reply from node 100070a: 0 bytes CLVMD[41495950]: Jan 23 12:31:11 Got 1 replies, expecting: 2 CLVMD[41495950]: Jan 23 12:31:11 LVM thread waiting for work CLVMD[cee0f780]: Jan 23 12:31:11 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[cee0f780]: Jan 23 12:31:11 Reply from node 200070a: 0 bytes CLVMD[cee0f780]: Jan 23 12:31:11 Got 2 replies, expecting: 2 CLVMD[41c96950]: Jan 23 12:31:11 Got post command condition... CLVMD[41c96950]: Jan 23 12:31:11 Waiting for next pre command CLVMD[cee0f780]: Jan 23 12:31:11 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:11 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:11 Send local reply CLVMD[cee0f780]: Jan 23 12:31:11 Read on local socket 7, len = 28 CLVMD[cee0f780]: Jan 23 12:31:11 check_all_clvmds_running CLVMD[cee0f780]: Jan 23 12:31:11 down_callback. node 16779018, state = 3 CLVMD[cee0f780]: Jan 23 12:31:11 down_callback. node 33556234, state = 3 CLVMD[41c96950]: Jan 23 12:31:11 Got pre command condition... CLVMD[41c96950]: Jan 23 12:31:11 Writing status 0 down pipe 9 CLVMD[41c96950]: Jan 23 12:31:11 Waiting to do post command - state = 0 CLVMD[cee0f780]: Jan 23 12:31:11 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:11 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:11 distribute command: XID = 15 CLVMD[cee0f780]: Jan 23 12:31:11 num_nodes = 2 CLVMD[cee0f780]: Jan 23 12:31:11 add_to_lvmqueue: cmd=0x69f2e0. client=0x69f0d0, msg=0x7a8fd0, len=28, csid=(nil), xid=15 CLVMD[cee0f780]: Jan 23 12:31:11 Sending message to all cluster nodes CLVMD[41495950]: Jan 23 12:31:11 process_work_item: local CLVMD[41495950]: Jan 23 12:31:11 process_local_command: LOCK_VG (0x33) msg=0x7a9880, msglen =28, client=0x69f0d0 CLVMD[41495950]: Jan 23 12:31:11 Dropping metadata for VG xenvg CLVMD[41495950]: Jan 23 12:31:11 Reply from node 100070a: 0 bytes CLVMD[41495950]: Jan 23 12:31:11 Got 1 replies, expecting: 2 CLVMD[41495950]: Jan 23 12:31:11 LVM thread waiting for work CLVMD[cee0f780]: Jan 23 12:31:11 16779018 got message from nodeid 16779018 for 0. len 28 CLVMD[cee0f780]: Jan 23 12:31:11 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[cee0f780]: Jan 23 12:31:11 Reply from node 200070a: 0 bytes CLVMD[cee0f780]: Jan 23 12:31:11 Got 2 replies, expecting: 2 CLVMD[41c96950]: Jan 23 12:31:11 Got post command condition... CLVMD[41c96950]: Jan 23 12:31:11 Waiting for next pre command CLVMD[cee0f780]: Jan 23 12:31:11 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:11 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:11 Send local reply CLVMD[cee0f780]: Jan 23 12:31:11 Read on local socket 7, len = 28 CLVMD[cee0f780]: Jan 23 12:31:11 check_all_clvmds_running CLVMD[cee0f780]: Jan 23 12:31:11 down_callback. node 16779018, state = 3 CLVMD[cee0f780]: Jan 23 12:31:11 down_callback. node 33556234, state = 3 CLVMD[41c96950]: Jan 23 12:31:11 Got pre command condition... CLVMD[41c96950]: Jan 23 12:31:11 Writing status 0 down pipe 9 CLVMD[41c96950]: Jan 23 12:31:11 Waiting to do post command - state = 0 CLVMD[cee0f780]: Jan 23 12:31:11 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:11 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:11 distribute command: XID = 16 CLVMD[cee0f780]: Jan 23 12:31:11 num_nodes = 2 CLVMD[cee0f780]: Jan 23 12:31:11 add_to_lvmqueue: cmd=0x69f2e0. client=0x69f0d0, msg=0x7a8fd0, len=28, csid=(nil), xid=16 CLVMD[41495950]: Jan 23 12:31:11 process_work_item: local CLVMD[41495950]: Jan 23 12:31:11 process_local_command: LOCK_VG (0x33) msg=0x7a9880, msglen =28, client=0x69f0d0 CLVMD[41495950]: Jan 23 12:31:11 Dropping metadata for VG xenvg CLVMD[41495950]: Jan 23 12:31:11 Reply from node 100070a: 0 bytes CLVMD[41495950]: Jan 23 12:31:11 Got 1 replies, expecting: 2 CLVMD[41495950]: Jan 23 12:31:11 LVM thread waiting for work CLVMD[cee0f780]: Jan 23 12:31:11 Sending message to all cluster nodes CLVMD[cee0f780]: Jan 23 12:31:11 16779018 got message from nodeid 16779018 for 0. len 28 CLVMD[cee0f780]: Jan 23 12:31:11 16779018 got message from nodeid 33556234 for 16779018. len 18 CLVMD[cee0f780]: Jan 23 12:31:11 Reply from node 200070a: 0 bytes CLVMD[cee0f780]: Jan 23 12:31:11 Got 2 replies, expecting: 2 CLVMD[41c96950]: Jan 23 12:31:11 Got post command condition... CLVMD[41c96950]: Jan 23 12:31:11 Waiting for next pre command CLVMD[cee0f780]: Jan 23 12:31:11 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:11 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:11 Send local reply CLVMD[cee0f780]: Jan 23 12:31:11 Read on local socket 7, len = 28 CLVMD[41c96950]: Jan 23 12:31:11 Got pre command condition... CLVMD[41c96950]: Jan 23 12:31:11 doing PRE command LOCK_VG 'V_xenvg' at 6 (client=0x69f0d0) CLVMD[41c96950]: Jan 23 12:31:11 unlock_resource V_xenvg-1 CLVMD[41c96950]: Jan 23 12:31:11 unlock_resource V_xenvg-2 CLVMD[41c96950]: Jan 23 12:31:11 unlock_resource: lockid: 1190cde700000000 CLVMD[41c96950]: Jan 23 12:31:11 Writing status 0 down pipe 9 CLVMD[41c96950]: Jan 23 12:31:11 Waiting to do post command - state = 0 CLVMD[cee0f780]: Jan 23 12:31:11 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:11 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:11 distribute command: XID = 17 CLVMD[cee0f780]: Jan 23 12:31:11 add_to_lvmqueue: cmd=0x69f2e0. client=0x69f0d0, msg=0x7a8fd0, len=28, csid=(nil), xid=17 CLVMD[41495950]: Jan 23 12:31:11 process_work_item: local CLVMD[41495950]: Jan 23 12:31:11 process_local_command: LOCK_VG (0x33) msg=0x69f250, msglen =28, client=0x69f0d0 CLVMD[41495950]: Jan 23 12:31:11 Dropping metadata for VG xenvg CLVMD[41495950]: Jan 23 12:31:11 Reply from node 100070a: 0 bytes CLVMD[41495950]: Jan 23 12:31:11 Got 1 replies, expecting: 1 CLVMD[41495950]: Jan 23 12:31:11 LVM thread waiting for work CLVMD[41c96950]: Jan 23 12:31:11 Got post command condition... CLVMD[41c96950]: Jan 23 12:31:11 Waiting for next pre command CLVMD[cee0f780]: Jan 23 12:31:11 read on PIPE 8: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:11 background routine status was 0, sock_client=0x69f0d0 CLVMD[cee0f780]: Jan 23 12:31:11 Send local reply CLVMD[cee0f780]: Jan 23 12:31:11 Read on local socket 7, len = 0 CLVMD[cee0f780]: Jan 23 12:31:11 EOF on local socket: inprogress=0 CLVMD[cee0f780]: Jan 23 12:31:11 Waiting for child thread CLVMD[41c96950]: Jan 23 12:31:11 Got pre command condition... CLVMD[41c96950]: Jan 23 12:31:11 Subthread finished CLVMD[cee0f780]: Jan 23 12:31:11 Joined child thread CLVMD[cee0f780]: Jan 23 12:31:11 ret == 0, errno = 9. removing client CLVMD[cee0f780]: Jan 23 12:31:11 add_to_lvmqueue: cmd=0x69f2e0. client=0x69f0d0, msg=(nil), len=0, csid=(nil), xid=17 CLVMD[41495950]: Jan 23 12:31:11 process_work_item: free fd 7 CLVMD[41495950]: Jan 23 12:31:11 LVM thread waiting for work CLVMD[cee0f780]: Jan 23 12:31:25 16779018 got message from nodeid 33556234 for 0. len 28 CLVMD[cee0f780]: Jan 23 12:31:25 add_to_lvmqueue: cmd=0x69f2e0. client=0x673cc0, msg=0x7f3fcd52b07f, len=28, csid=0x7fff2cdff774, xid=0 CLVMD[41495950]: Jan 23 12:31:25 process_work_item: remote CLVMD[41495950]: Jan 23 12:31:25 process_remote_command LOCK_VG (0x33) for clientid 0x8000000 XID 1 on node 200070a CLVMD[41495950]: Jan 23 12:31:25 Dropping metadata for VG xenvg CLVMD[41495950]: Jan 23 12:31:25 LVM thread waiting for work CLVMD[cee0f780]: Jan 23 12:31:25 16779018 got message from nodeid 16779018 for 33556234. len 18 CLVMD[cee0f780]: Jan 23 12:31:25 16779018 got message from nodeid 33556234 for 0. len 28 CLVMD[cee0f780]: Jan 23 12:31:25 add_to_lvmqueue: cmd=0x69f2e0. client=0x673cc0, msg=0x7f3fcd52b225, len=28, csid=0x7fff2cdff774, xid=0 CLVMD[41495950]: Jan 23 12:31:25 process_work_item: remote CLVMD[41495950]: Jan 23 12:31:25 process_remote_command LOCK_VG (0x33) for clientid 0x8000000 XID 2 on node 200070a CLVMD[41495950]: Jan 23 12:31:25 Dropping metadata for VG xenvg CLVMD[41495950]: Jan 23 12:31:25 LVM thread waiting for work CLVMD[cee0f780]: Jan 23 12:31:25 16779018 got message from nodeid 16779018 for 33556234. len 18 CLVMD[cee0f780]: Jan 23 12:31:26 16779018 got message from nodeid 33556234 for 0. len 85 CLVMD[cee0f780]: Jan 23 12:31:26 add_to_lvmqueue: cmd=0x69f2e0. client=0x673cc0, msg=0x7f3fcd52b3cb, len=85, csid=0x7fff2cdff774, xid=0 CLVMD[41495950]: Jan 23 12:31:26 process_work_item: remote CLVMD[41495950]: Jan 23 12:31:26 process_remote_command LOCK_LV (0x32) for clientid 0x8000000 XID 3 on node 200070a CLVMD[41495950]: Jan 23 12:31:26 do_lock_lv: resource 'XgQ3JnQrCyhGWBoDqpXzYsyN1frLCaXW2fhlycqW6eh5Wg2WmOdrHESQBMBkhM5q', cmd = 0x19 LCK_LV_ACTIVATE (READ|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[41495950]: Jan 23 12:31:26 lock_resource 'XgQ3JnQrCyhGWBoDqpXzYsyN1frLCaXW2fhlycqW6eh5Wg2WmOdrHESQBMBkhM5q-1', flags=1, mode=1 CLVMD[41495950]: Jan 23 12:31:26 lock_resource returning 1, lock_id=3352255a00000000 CLVMD[41495950]: Jan 23 12:31:26 unlock_resource XgQ3JnQrCyhGWBoDqpXzYsyN1frLCaXW2fhlycqW6eh5Wg2WmOdrHESQBMBkhM5q-2 CLVMD[41495950]: Jan 23 12:31:26 Command return is 0 CLVMD[41495950]: Jan 23 12:31:26 LVM thread waiting for work CLVMD[cee0f780]: Jan 23 12:31:26 16779018 got message from nodeid 16779018 for 33556234. len 18 CLVMD[cee0f780]: Jan 23 12:31:26 16779018 got message from nodeid 33556234 for 0. len 28 CLVMD[cee0f780]: Jan 23 12:31:26 add_to_lvmqueue: cmd=0x69f2e0. client=0x673cc0, msg=0x7f3fcd52b5aa, len=28, csid=0x7fff2cdff774, xid=0 CLVMD[41495950]: Jan 23 12:31:26 process_work_item: remote CLVMD[41495950]: Jan 23 12:31:26 process_remote_command LOCK_VG (0x33) for clientid 0x8000000 XID 4 on node 200070a CLVMD[41495950]: Jan 23 12:31:26 Dropping metadata for VG xenvg CLVMD[41495950]: Jan 23 12:31:26 LVM thread waiting for work CLVMD[cee0f780]: Jan 23 12:31:26 16779018 got message from nodeid 16779018 for 33556234. len 18 CLVMD[cee0f780]: Jan 23 12:31:38 16779018 got message from nodeid 33556234 for 0. len 85 CLVMD[cee0f780]: Jan 23 12:31:38 add_to_lvmqueue: cmd=0x69f2e0. client=0x673cc0, msg=0x7f3fcd52b750, len=85, csid=0x7fff2cdff774, xid=0 CLVMD[41495950]: Jan 23 12:31:38 process_work_item: remote CLVMD[41495950]: Jan 23 12:31:38 process_remote_command LOCK_LV (0x32) for clientid 0x7000000 XID 7 on node 200070a CLVMD[41495950]: Jan 23 12:31:38 do_lock_lv: resource 'XgQ3JnQrCyhGWBoDqpXzYsyN1frLCaXW2fhlycqW6eh5Wg2WmOdrHESQBMBkhM5q', cmd = 0x18 LCK_LV_DEACTIVATE (NULL|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[41495950]: Jan 23 12:31:38 unlock_resource XgQ3JnQrCyhGWBoDqpXzYsyN1frLCaXW2fhlycqW6eh5Wg2WmOdrHESQBMBkhM5q-1 CLVMD[41495950]: Jan 23 12:31:38 unlock_resource: lockid: 3352255a00000000 CLVMD[41495950]: Jan 23 12:31:38 unlock_resource XgQ3JnQrCyhGWBoDqpXzYsyN1frLCaXW2fhlycqW6eh5Wg2WmOdrHESQBMBkhM5q-2 CLVMD[41495950]: Jan 23 12:31:38 Command return is 0 CLVMD[41495950]: Jan 23 12:31:38 LVM thread waiting for work CLVMD[cee0f780]: Jan 23 12:31:38 16779018 got message from nodeid 16779018 for 33556234. len 18 CLVMD[cee0f780]: Jan 23 12:31:38 16779018 got message from nodeid 33556234 for 0. len 85 CLVMD[cee0f780]: Jan 23 12:31:38 add_to_lvmqueue: cmd=0x69f2e0. client=0x673cc0, msg=0x7f3fcd52b92f, len=85, csid=0x7fff2cdff774, xid=0 CLVMD[41495950]: Jan 23 12:31:38 process_work_item: remote CLVMD[41495950]: Jan 23 12:31:38 process_remote_command LOCK_LV (0x32) for clientid 0x7000000 XID 8 on node 200070a CLVMD[41495950]: Jan 23 12:31:38 do_lock_lv: resource 'XgQ3JnQrCyhGWBoDqpXzYsyN1frLCaXW2fhlycqW6eh5Wg2WmOdrHESQBMBkhM5q', cmd = 0x1e LCK_LV_RESUME (UNLOCK|LV|NONBLOCK), flags = 0x84 (DMEVENTD_MONITOR ) CLVMD[41495950]: Jan 23 12:31:38 do_resume_lv, lock not already held CLVMD[41495950]: Jan 23 12:31:38 Command return is 0 CLVMD[41495950]: Jan 23 12:31:38 LVM thread waiting for work CLVMD[cee0f780]: Jan 23 12:31:38 16779018 got message from nodeid 16779018 for 33556234. len 18 CLVMD[cee0f780]: Jan 23 12:31:38 16779018 got message from nodeid 33556234 for 0. len 28 CLVMD[cee0f780]: Jan 23 12:31:38 add_to_lvmqueue: cmd=0x69f2e0. client=0x673cc0, msg=0x7f3fcd52bb0e, len=28, csid=0x7fff2cdff774, xid=0 CLVMD[41495950]: Jan 23 12:31:38 process_work_item: remote CLVMD[41495950]: Jan 23 12:31:38 process_remote_command LOCK_VG (0x33) for clientid 0x7000000 XID 9 on node 200070a CLVMD[41495950]: Jan 23 12:31:38 Dropping metadata for VG xenvg CLVMD[41495950]: Jan 23 12:31:38 LVM thread waiting for work CLVMD[cee0f780]: Jan 23 12:31:38 16779018 got message from nodeid 16779018 for 33556234. len 18 CLVMD[cee0f780]: Jan 23 12:31:38 16779018 got message from nodeid 33556234 for 0. len 28 CLVMD[cee0f780]: Jan 23 12:31:38 add_to_lvmqueue: cmd=0x69f2e0. client=0x673cc0, msg=0x7f3fcd52bcb4, len=28, csid=0x7fff2cdff774, xid=0 CLVMD[41495950]: Jan 23 12:31:38 process_work_item: remote CLVMD[41495950]: Jan 23 12:31:38 process_remote_command LOCK_VG (0x33) for clientid 0x7000000 XID 10 on node 200070a CLVMD[41495950]: Jan 23 12:31:38 Dropping metadata for VG xenvg CLVMD[41495950]: Jan 23 12:31:38 LVM thread waiting for work CLVMD[cee0f780]: Jan 23 12:31:38 16779018 got message from nodeid 16779018 for 33556234. len 18 CLVMD[cee0f780]: Jan 23 12:31:51 Got new connection on fd 8 CLVMD[cee0f780]: Jan 23 12:31:51 Read on local socket 8, len = 28 CLVMD[cee0f780]: Jan 23 12:31:51 creating pipe, [9, 10] CLVMD[cee0f780]: Jan 23 12:31:51 Creating pre&post thread CLVMD[41c96950]: Jan 23 12:31:51 in sub thread: client = 0x7a8e80 CLVMD[41c96950]: Jan 23 12:31:51 Sub thread ready for work. CLVMD[41c96950]: Jan 23 12:31:51 doing PRE command LOCK_VG 'V_xenvg' at 1 (client=0x7a8e80) CLVMD[41c96950]: Jan 23 12:31:51 lock_resource 'V_xenvg-1', flags=0, mode=1 CLVMD[cee0f780]: Jan 23 12:31:51 Created pre&post thread, state = 0 CLVMD[41c96950]: Jan 23 12:31:51 lock_resource returning 1, lock_id=7fdcc23300000000 CLVMD[41c96950]: Jan 23 12:31:51 unlock_resource V_xenvg-2 CLVMD[41c96950]: Jan 23 12:31:51 Writing status 0 down pipe 10 CLVMD[41c96950]: Jan 23 12:31:51 Waiting to do post command - state = 0 CLVMD[cee0f780]: Jan 23 12:31:51 read on PIPE 9: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:51 background routine status was 0, sock_client=0x7a8e80 CLVMD[cee0f780]: Jan 23 12:31:51 distribute command: XID = 18 CLVMD[cee0f780]: Jan 23 12:31:51 add_to_lvmqueue: cmd=0x69f2e0. client=0x7a8e80, msg=0x69f4b0, len=28, csid=(nil), xid=18 CLVMD[41495950]: Jan 23 12:31:51 process_work_item: local CLVMD[41495950]: Jan 23 12:31:51 process_local_command: LOCK_VG (0x33) msg=0x69f250, msglen =28, client=0x7a8e80 CLVMD[41495950]: Jan 23 12:31:51 Dropping metadata for VG xenvg CLVMD[41495950]: Jan 23 12:31:51 Reply from node 100070a: 0 bytes CLVMD[41495950]: Jan 23 12:31:51 Got 1 replies, expecting: 1 CLVMD[41495950]: Jan 23 12:31:51 LVM thread waiting for work CLVMD[41c96950]: Jan 23 12:31:51 Got post command condition... CLVMD[41c96950]: Jan 23 12:31:51 Waiting for next pre command CLVMD[cee0f780]: Jan 23 12:31:51 read on PIPE 9: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:51 background routine status was 0, sock_client=0x7a8e80 CLVMD[cee0f780]: Jan 23 12:31:51 Send local reply CLVMD[cee0f780]: Jan 23 12:31:51 Read on local socket 8, len = 28 CLVMD[41c96950]: Jan 23 12:31:51 Got pre command condition... CLVMD[41c96950]: Jan 23 12:31:51 doing PRE command LOCK_VG 'V_xenvg' at 6 (client=0x7a8e80) CLVMD[41c96950]: Jan 23 12:31:51 unlock_resource V_xenvg-1 CLVMD[41c96950]: Jan 23 12:31:51 unlock_resource: lockid: 7fdcc23300000000 CLVMD[41c96950]: Jan 23 12:31:51 unlock_resource V_xenvg-2 CLVMD[41c96950]: Jan 23 12:31:51 Writing status 0 down pipe 10 CLVMD[41c96950]: Jan 23 12:31:51 Waiting to do post command - state = 0 CLVMD[cee0f780]: Jan 23 12:31:51 read on PIPE 9: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:51 background routine status was 0, sock_client=0x7a8e80 CLVMD[cee0f780]: Jan 23 12:31:51 distribute command: XID = 19 CLVMD[cee0f780]: Jan 23 12:31:51 add_to_lvmqueue: cmd=0x69f2e0. client=0x7a8e80, msg=0x69f4b0, len=28, csid=(nil), xid=19 CLVMD[41495950]: Jan 23 12:31:51 process_work_item: local CLVMD[41495950]: Jan 23 12:31:51 process_local_command: LOCK_VG (0x33) msg=0x69f100, msglen =28, client=0x7a8e80 CLVMD[41495950]: Jan 23 12:31:51 Dropping metadata for VG xenvg CLVMD[41495950]: Jan 23 12:31:51 Reply from node 100070a: 0 bytes CLVMD[41495950]: Jan 23 12:31:51 Got 1 replies, expecting: 1 CLVMD[41495950]: Jan 23 12:31:51 LVM thread waiting for work CLVMD[41c96950]: Jan 23 12:31:51 Got post command condition... CLVMD[41c96950]: Jan 23 12:31:51 Waiting for next pre command CLVMD[cee0f780]: Jan 23 12:31:51 read on PIPE 9: 4 bytes: status: 0 CLVMD[cee0f780]: Jan 23 12:31:51 background routine status was 0, sock_client=0x7a8e80 CLVMD[cee0f780]: Jan 23 12:31:51 Send local reply CLVMD[cee0f780]: Jan 23 12:31:51 Read on local socket 8, len = 0 CLVMD[cee0f780]: Jan 23 12:31:51 EOF on local socket: inprogress=0 CLVMD[cee0f780]: Jan 23 12:31:51 Waiting for child thread CLVMD[41c96950]: Jan 23 12:31:51 Got pre command condition... CLVMD[41c96950]: Jan 23 12:31:51 Subthread finished CLVMD[cee0f780]: Jan 23 12:31:51 Joined child thread CLVMD[cee0f780]: Jan 23 12:31:51 ret == 0, errno = 9. removing client CLVMD[cee0f780]: Jan 23 12:31:51 add_to_lvmqueue: cmd=0x69f2e0. client=0x7a8e80, msg=(nil), len=0, csid=(nil), xid=19 CLVMD[41495950]: Jan 23 12:31:51 process_work_item: free fd 8 CLVMD[41495950]: Jan 23 12:31:51 LVM thread waiting for work