paho.mqtt.java icon indicating copy to clipboard operation
paho.mqtt.java copied to clipboard
verified publisher icon eclipse

Sometimes a 'deadlock' may occur when resubscribing to a topic in the connectComplete callback

Open QBH-insist opened this issue 2 years ago • 2 comments

  • [x] Bug exists Release Version 1.2.5 ( Master Branch)
  • [x] Bug exists in MQTTv3 Client on Snapshot Version 1.2.6-SNAPSHOT (Develop Branch)
  • [ ] Bug exists in MQTTv5 Client on Snapshot Version 1.2.6-SNAPSHOT (Develop Branch)

Reproduction steps

  1. create a sub client（subscribing to a topic in the connectComplete callback） public void connectComplete(boolean reconnect, String serverURI) { myClient.subscribe(this.topic); } and create a pub client
  2. the pub client continuously publishes messages.
  3. the sub client receive messages
  4. then, close the sub client whille the pub client continues to publish message, ensuring that the pub client still published more than 10 message
  5. now, the sub client session(in broker) has more than 10 unconsumed messages
  6. close the pub client, reconnect the sub client(sub client id must unchanged)
  7. finally, the sub client will be blocked until the checkForActivity method closes the client
���� 11, 2023 5:22:46 ���� org.eclipse.paho.client.mqttv3.internal.ClientState checkForActivity
����: client1: Timed out as no activity, keepAlive=15,000,000,000 lastOutboundActivity=202,748,527,866,900 lastInboundActivity=202,733,513,164,800 time=202,763,529,941,000 lastPing=202,748,527,900,000
on connectionLost

More Information

  1. the checkForActivity Method closes the client because that client was not received MqttPingResp(ping response)
  2. additionally, I've discovered that subscribe ack(MqttSuback) was not recevied either
  3. however, ping ack and sub ack both had been sent by the broker(EMQX Broker)

image image

  1. the sub client can recevied 10 message from broker when reconnecting（debug can found it, but did not send message ack)

Based on further speculation

  • the sub client hadn't received ping ack and sub ack
  • the status of the Rec Thread(CommsReceiver) may be in WAITING state

Reason analysis

Paho Mqtt Thread

  • CommsReceiver(receive message from broker)
  • CommsCallback(consume message)
  • CommsSender(publish meesage)

Client startup process (coarse-grained):

  1. connect packet sent
  2. connect ack recevied
  3. received message from broker if need
  4. the connectComplete called
  5. subscribe a topic in the connectComplete, and then the CallThread(CommsCallback) will wait until it gets sub ack notified

Rec Thread(CommsReceiver) Part

  1. connect ack received
  2. received message from broker(more than 10 messages)
  3. put the messages in the CommsCallback.messageQueue

image

  1. The important logic is coming：clientState.notifyReceivedMsg(message) Rec Thread(CommsReceiver) will wait when messageQueue.size() >= 10

image

Conclusion

1. The Call Thread(CommsCallback) state in WAITING when subscribe in the connectComplete 2. The Rec Thread(CommsReceiver) state in WAITING when CommsCallback.messageQueue size >= 10 3. The CommsCallback.messageQueue consumed in Call Thread(CommsCallback), but Call Thread(CommsCallback) state in WAITING now 4. The Rec Thread(CommsReceiver) state in WAITING, Thus Ping Ack and Sub Ack are never received. 5. Based on the above point, The Call Thread(CommsCallback) will not be notified 6. Finally, The PingTask will close the client

QBH-insist avatar May 12 '23 01:05 QBH-insist

m

zhubinsheng avatar Aug 04 '24 03:08 zhubinsheng

similar issues

2024-12-11 01:47:38
Full thread dump Java HotSpot(TM) 64-Bit Server VM (25.144-b01 mixed mode):

"MQTT Rec: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_hjt212" #205741 prio=5 os_prio=0 tid=0x00007f4c08238800 nid=0x2b3d runnable [0x00007f4bd6efa000]
   java.lang.Thread.State: RUNNABLE
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:171)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at java.net.SocketInputStream.read(SocketInputStream.java:224)
	at java.io.DataInputStream.readByte(DataInputStream.java:265)
	at org.eclipse.paho.mqttv5.client.wire.MqttInputStream.readMqttWireMessage(MqttInputStream.java:96)
	at org.eclipse.paho.mqttv5.client.internal.CommsReceiver.run(CommsReceiver.java:139)
	at java.lang.Thread.run(Thread.java:748)

"MQTT Con: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_hjt212" #205740 prio=5 os_prio=0 tid=0x00007f4bf8079000 nid=0x2b3c waiting on condition [0x00007f4bd7afa000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at org.eclipse.paho.mqttv5.client.internal.CommsReceiver.start(CommsReceiver.java:86)
	at org.eclipse.paho.mqttv5.client.internal.ClientComms$ConnectBG.run(ClientComms.java:785)
	at java.lang.Thread.run(Thread.java:748)

"MQTT Snd: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_realtime" #205739 prio=5 os_prio=0 tid=0x00007f4c040c1000 nid=0x2b3b in Object.wait() [0x00007f4bd73fa000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at org.eclipse.paho.mqttv5.client.internal.ClientState.get(ClientState.java:833)
	- locked <0x00000006c8524438> (a java.lang.Object)
	at org.eclipse.paho.mqttv5.client.internal.CommsSender.run(CommsSender.java:130)
	at java.lang.Thread.run(Thread.java:748)

"MQTT Rec: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_realtime" #205738 prio=5 os_prio=0 tid=0x00007f4c040c0800 nid=0x2b34 runnable [0x00007f4bd86fa000]
   java.lang.Thread.State: RUNNABLE
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:171)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at java.net.SocketInputStream.read(SocketInputStream.java:224)
	at java.io.DataInputStream.readByte(DataInputStream.java:265)
	at org.eclipse.paho.mqttv5.client.wire.MqttInputStream.readMqttWireMessage(MqttInputStream.java:96)
	at org.eclipse.paho.mqttv5.client.internal.CommsReceiver.run(CommsReceiver.java:139)
	at java.lang.Thread.run(Thread.java:748)

"MQTT Con: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_realtime" #205737 prio=5 os_prio=0 tid=0x00007f4bf406c000 nid=0x2b33 waiting on condition [0x00007f4bd70fa000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at org.eclipse.paho.mqttv5.client.internal.CommsSender.start(CommsSender.java:80)
	at org.eclipse.paho.mqttv5.client.internal.ClientComms$ConnectBG.run(ClientComms.java:787)
	at java.lang.Thread.run(Thread.java:748)

"MQTT Reconnect: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_hjt212" #205736 prio=5 os_prio=0 tid=0x000000000103c800 nid=0x2b29 in Object.wait() [0x00007f4bd71fa000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at java.util.TimerThread.mainLoop(Timer.java:526)
	- locked <0x000000076d960d10> (a java.util.TaskQueue)
	at java.util.TimerThread.run(Timer.java:505)

"MQTT Reconnect: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_realtime" #205733 prio=5 os_prio=0 tid=0x00007f4c5402c000 nid=0x2b26 in Object.wait() [0x00007f4bde4fd000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at java.util.TimerThread.mainLoop(Timer.java:526)
	- locked <0x000000076d93d268> (a java.util.TaskQueue)
	at java.util.TimerThread.run(Timer.java:505)

"Attach Listener" #205532 daemon prio=9 os_prio=0 tid=0x00007f4c3c008000 nid=0x2a5b waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"MQTT Reconnect: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_realtime" #193052 prio=5 os_prio=0 tid=0x00007f4c2c004800 nid=0x7834 in Object.wait() [0x00007f4bde5fd000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at java.util.TimerThread.mainLoop(Timer.java:526)
	- locked <0x00000006cfbd0870> (a java.util.TaskQueue)
	at java.util.TimerThread.run(Timer.java:505)

"omcpUpperDataProcess-18" #191492 prio=5 os_prio=0 tid=0x00007f4c0c0f0000 nid=0x721c waiting on condition [0x00007f4bd78fa000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at com.szboanda.omcp.upperservice.dataaccess.mqtt.MqttMessageSender.sendMessage(MqttMessageSender.java:187)
	at com.szboanda.omcp.upperservice.gather.storage.impl.MqttStorer.store(MqttStorer.java:158)
	at com.szboanda.omcp.upperservice.gather.storage.StorageService.storageData(StorageService.java:71)
	at com.szboanda.omcp.upperservice.gather.storage.StorageDataHandler.handle(StorageDataHandler.java:38)
	at com.szboanda.omcp.upperservice.gather.ChainStepManager.doChainHandle(ChainStepManager.java:118)
	at com.szboanda.omcp.upperservice.protocol.hjt212.command.impl.classify.MonitorDataCommand.action(MonitorDataCommand.java:36)
	at com.szboanda.omcp.upperservice.protocol.hjt212.HJT212Protocol.processData(HJT212Protocol.java:143)
	at com.szboanda.omcp.upperservice.dataprocess.concurrent.DataProcessRunnable.run(DataProcessRunnable.java:41)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperDataProcess-17" #190429 prio=5 os_prio=0 tid=0x00007f4bf8004800 nid=0x6df4 waiting on condition [0x00007f4bd84fa000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at com.szboanda.omcp.upperservice.dataaccess.mqtt.MqttMessageSender.sendMessage(MqttMessageSender.java:187)
	at com.szboanda.omcp.upperservice.gather.storage.impl.MqttStorer.store(MqttStorer.java:158)
	at com.szboanda.omcp.upperservice.gather.storage.StorageService.storageData(StorageService.java:71)
	at com.szboanda.omcp.upperservice.gather.storage.StorageDataHandler.handle(StorageDataHandler.java:38)
	at com.szboanda.omcp.upperservice.gather.ChainStepManager.doChainHandle(ChainStepManager.java:118)
	at com.szboanda.omcp.upperservice.protocol.hjt212.command.impl.classify.MonitorDataCommand.action(MonitorDataCommand.java:36)
	at com.szboanda.omcp.upperservice.protocol.hjt212.HJT212Protocol.processData(HJT212Protocol.java:143)
	at com.szboanda.omcp.upperservice.dataprocess.concurrent.DataProcessRunnable.run(DataProcessRunnable.java:41)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperDataProcess-16" #190428 prio=5 os_prio=0 tid=0x00007f4c0001d800 nid=0x6df3 waiting on condition [0x00007f4bd88fa000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at com.szboanda.omcp.upperservice.dataaccess.mqtt.MqttMessageSender.sendMessage(MqttMessageSender.java:187)
	at com.szboanda.omcp.upperservice.gather.storage.impl.MqttStorer.store(MqttStorer.java:158)
	at com.szboanda.omcp.upperservice.gather.storage.StorageService.storageData(StorageService.java:71)
	at com.szboanda.omcp.upperservice.gather.storage.StorageDataHandler.handle(StorageDataHandler.java:38)
	at com.szboanda.omcp.upperservice.gather.ChainStepManager.doChainHandle(ChainStepManager.java:118)
	at com.szboanda.omcp.upperservice.protocol.hjt212.command.impl.classify.MonitorDataCommand.action(MonitorDataCommand.java:36)
	at com.szboanda.omcp.upperservice.protocol.hjt212.HJT212Protocol.processData(HJT212Protocol.java:143)
	at com.szboanda.omcp.upperservice.dataprocess.concurrent.DataProcessRunnable.run(DataProcessRunnable.java:41)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"MQTT Reconnect: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_realtime" #182336 prio=5 os_prio=0 tid=0x00007f4c4c01e800 nid=0x4e56 in Object.wait() [0x00007f4bd72fa000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at java.util.TimerThread.mainLoop(Timer.java:526)
	- locked <0x00000006cf8f72d0> (a java.util.TaskQueue)
	at java.util.TimerThread.run(Timer.java:505)

"MQTT Reconnect: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_realtime" #173140 prio=5 os_prio=0 tid=0x00007f4c1800e000 nid=0x2a5f in Object.wait() [0x00007f4bd76fa000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at java.util.TimerThread.mainLoop(Timer.java:526)
	- locked <0x00000006cf6cba20> (a java.util.TaskQueue)
	at java.util.TimerThread.run(Timer.java:505)

"MQTT Reconnect: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_realtime" #171676 prio=5 os_prio=0 tid=0x00007f4c3c005000 nid=0x24a6 in Object.wait() [0x00007f4bd7cfa000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at java.util.TimerThread.mainLoop(Timer.java:526)
	- locked <0x00000006cf66faa8> (a java.util.TaskQueue)
	at java.util.TimerThread.run(Timer.java:505)

"MQTT Reconnect: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_hjt212" #166070 prio=5 os_prio=0 tid=0x00007f4c24010800 nid=0xebc in Object.wait() [0x00007f4bde3fd000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at java.util.TimerThread.mainLoop(Timer.java:526)
	- locked <0x00000006cf3f5738> (a java.util.TaskQueue)
	at java.util.TimerThread.run(Timer.java:505)

"MQTT Reconnect: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_realtime" #158588 prio=5 os_prio=0 tid=0x00007f4c38417800 nid=0x7053 in Object.wait() [0x00007f4bde2fd000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at java.util.TimerThread.mainLoop(Timer.java:526)
	- locked <0x00000006cf22b8f0> (a java.util.TaskQueue)
	at java.util.TimerThread.run(Timer.java:505)

"MQTT Reconnect: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_hjt212" #149006 prio=5 os_prio=0 tid=0x00007f4c0001e800 nid=0x4ae4 in Object.wait() [0x00007f4bd79fa000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at java.util.TimerThread.mainLoop(Timer.java:526)
	- locked <0x00000006cefee758> (a java.util.TaskQueue)
	at java.util.TimerThread.run(Timer.java:505)

"omcpUpperDataProcess-15" #147036 prio=5 os_prio=0 tid=0x00007f4bfc04d000 nid=0x4332 waiting on condition [0x00007f4bd7bfa000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at com.szboanda.omcp.upperservice.dataaccess.mqtt.MqttMessageSender.sendMessage(MqttMessageSender.java:187)
	at com.szboanda.omcp.upperservice.gather.storage.impl.MqttStorer.store(MqttStorer.java:158)
	at com.szboanda.omcp.upperservice.gather.storage.StorageService.storageData(StorageService.java:71)
	at com.szboanda.omcp.upperservice.gather.storage.StorageDataHandler.handle(StorageDataHandler.java:38)
	at com.szboanda.omcp.upperservice.gather.ChainStepManager.doChainHandle(ChainStepManager.java:118)
	at com.szboanda.omcp.upperservice.protocol.hjt212.command.impl.classify.MonitorDataCommand.action(MonitorDataCommand.java:36)
	at com.szboanda.omcp.upperservice.protocol.hjt212.HJT212Protocol.processData(HJT212Protocol.java:143)
	at com.szboanda.omcp.upperservice.dataprocess.concurrent.DataProcessRunnable.run(DataProcessRunnable.java:41)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperDataProcess-14" #147026 prio=5 os_prio=0 tid=0x00007f4bf004d000 nid=0x4328 waiting on condition [0x00007f4bd7dfa000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at com.szboanda.omcp.upperservice.dataaccess.mqtt.MqttMessageSender.sendMessage(MqttMessageSender.java:187)
	at com.szboanda.omcp.upperservice.gather.storage.impl.MqttStorer.store(MqttStorer.java:158)
	at com.szboanda.omcp.upperservice.gather.storage.StorageService.storageData(StorageService.java:71)
	at com.szboanda.omcp.upperservice.gather.storage.StorageDataHandler.handle(StorageDataHandler.java:38)
	at com.szboanda.omcp.upperservice.gather.ChainStepManager.doChainHandle(ChainStepManager.java:118)
	at com.szboanda.omcp.upperservice.protocol.hjt212.command.impl.classify.MonitorDataCommand.action(MonitorDataCommand.java:36)
	at com.szboanda.omcp.upperservice.protocol.hjt212.HJT212Protocol.processData(HJT212Protocol.java:143)
	at com.szboanda.omcp.upperservice.dataprocess.concurrent.DataProcessRunnable.run(DataProcessRunnable.java:41)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperDataProcess-13" #147025 prio=5 os_prio=0 tid=0x00007f4c040bf800 nid=0x4327 waiting on condition [0x00007f4bd7efa000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at com.szboanda.omcp.upperservice.dataaccess.mqtt.MqttMessageSender.sendMessage(MqttMessageSender.java:187)
	at com.szboanda.omcp.upperservice.gather.storage.impl.MqttStorer.store(MqttStorer.java:158)
	at com.szboanda.omcp.upperservice.gather.storage.StorageService.storageData(StorageService.java:71)
	at com.szboanda.omcp.upperservice.gather.storage.StorageDataHandler.handle(StorageDataHandler.java:38)
	at com.szboanda.omcp.upperservice.gather.ChainStepManager.doChainHandle(ChainStepManager.java:118)
	at com.szboanda.omcp.upperservice.protocol.hjt212.command.impl.classify.MonitorDataCommand.action(MonitorDataCommand.java:36)
	at com.szboanda.omcp.upperservice.protocol.hjt212.HJT212Protocol.processData(HJT212Protocol.java:143)
	at com.szboanda.omcp.upperservice.dataprocess.concurrent.DataProcessRunnable.run(DataProcessRunnable.java:41)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperDataProcess-12" #147024 prio=5 os_prio=0 tid=0x00007f4c0c0fe000 nid=0x4326 waiting on condition [0x00007f4bd80fa000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at com.szboanda.omcp.upperservice.dataaccess.mqtt.MqttMessageSender.sendMessage(MqttMessageSender.java:187)
	at com.szboanda.omcp.upperservice.gather.storage.impl.MqttStorer.store(MqttStorer.java:158)
	at com.szboanda.omcp.upperservice.gather.storage.StorageService.storageData(StorageService.java:71)
	at com.szboanda.omcp.upperservice.gather.storage.StorageDataHandler.handle(StorageDataHandler.java:38)
	at com.szboanda.omcp.upperservice.gather.ChainStepManager.doChainHandle(ChainStepManager.java:118)
	at com.szboanda.omcp.upperservice.protocol.hjt212.command.impl.classify.MonitorDataCommand.action(MonitorDataCommand.java:36)
	at com.szboanda.omcp.upperservice.protocol.hjt212.HJT212Protocol.processData(HJT212Protocol.java:143)
	at com.szboanda.omcp.upperservice.dataprocess.concurrent.DataProcessRunnable.run(DataProcessRunnable.java:41)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperDataProcess-11" #147023 prio=5 os_prio=0 tid=0x00007f4bf8078800 nid=0x4325 waiting on condition [0x00007f4bd83fa000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at com.szboanda.omcp.upperservice.dataaccess.mqtt.MqttMessageSender.sendMessage(MqttMessageSender.java:187)
	at com.szboanda.omcp.upperservice.gather.storage.impl.MqttStorer.store(MqttStorer.java:158)
	at com.szboanda.omcp.upperservice.gather.storage.StorageService.storageData(StorageService.java:71)
	at com.szboanda.omcp.upperservice.gather.storage.StorageDataHandler.handle(StorageDataHandler.java:38)
	at com.szboanda.omcp.upperservice.gather.ChainStepManager.doChainHandle(ChainStepManager.java:118)
	at com.szboanda.omcp.upperservice.protocol.hjt212.command.impl.classify.MonitorDataCommand.action(MonitorDataCommand.java:36)
	at com.szboanda.omcp.upperservice.protocol.hjt212.HJT212Protocol.processData(HJT212Protocol.java:143)
	at com.szboanda.omcp.upperservice.dataprocess.concurrent.DataProcessRunnable.run(DataProcessRunnable.java:41)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperDataProcess-10" #147022 prio=5 os_prio=0 tid=0x00007f4bf8027000 nid=0x4324 waiting on condition [0x00007f4bd7ffa000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at com.szboanda.omcp.upperservice.dataaccess.mqtt.MqttMessageSender.sendMessage(MqttMessageSender.java:187)
	at com.szboanda.omcp.upperservice.gather.storage.impl.MqttStorer.store(MqttStorer.java:158)
	at com.szboanda.omcp.upperservice.gather.storage.StorageService.storageProtocolData(StorageService.java:149)
	at com.szboanda.omcp.upperservice.protocol.hjt212.action.CommonStorageAction.storageData(CommonStorageAction.java:66)
	at com.szboanda.omcp.upperservice.protocol.hjt212.command.AbstractCommand.action(AbstractCommand.java:91)
	at com.szboanda.omcp.upperservice.protocol.hjt212.HJT212Protocol.processData(HJT212Protocol.java:143)
	at com.szboanda.omcp.upperservice.dataprocess.concurrent.DataProcessRunnable.run(DataProcessRunnable.java:41)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperDataProcess-9" #147021 prio=5 os_prio=0 tid=0x00007f4c0005b800 nid=0x4323 waiting on condition [0x00007f4bd81fa000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at com.szboanda.omcp.upperservice.dataaccess.mqtt.MqttMessageSender.sendMessage(MqttMessageSender.java:187)
	at com.szboanda.omcp.upperservice.gather.storage.impl.MqttStorer.store(MqttStorer.java:158)
	at com.szboanda.omcp.upperservice.gather.storage.StorageService.storageProtocolData(StorageService.java:149)
	at com.szboanda.omcp.upperservice.protocol.hjt212.action.CommonStorageAction.storageData(CommonStorageAction.java:66)
	at com.szboanda.omcp.upperservice.protocol.hjt212.command.AbstractCommand.action(AbstractCommand.java:91)
	at com.szboanda.omcp.upperservice.protocol.hjt212.HJT212Protocol.processData(HJT212Protocol.java:143)
	at com.szboanda.omcp.upperservice.dataprocess.concurrent.DataProcessRunnable.run(DataProcessRunnable.java:41)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperDataProcess-8" #147020 prio=5 os_prio=0 tid=0x00007f4c040bf000 nid=0x4322 waiting on condition [0x00007f4bd8bfa000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at com.szboanda.omcp.upperservice.dataaccess.mqtt.MqttMessageSender.sendMessage(MqttMessageSender.java:187)
	at com.szboanda.omcp.upperservice.gather.storage.impl.MqttStorer.store(MqttStorer.java:158)
	at com.szboanda.omcp.upperservice.gather.storage.StorageService.storageProtocolData(StorageService.java:149)
	at com.szboanda.omcp.upperservice.protocol.hjt212.action.CommonStorageAction.storageData(CommonStorageAction.java:66)
	at com.szboanda.omcp.upperservice.protocol.hjt212.command.AbstractCommand.action(AbstractCommand.java:91)
	at com.szboanda.omcp.upperservice.protocol.hjt212.HJT212Protocol.processData(HJT212Protocol.java:143)
	at com.szboanda.omcp.upperservice.dataprocess.concurrent.DataProcessRunnable.run(DataProcessRunnable.java:41)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperDataProcess-7" #147019 prio=5 os_prio=0 tid=0x00007f4bfc04c800 nid=0x4321 waiting on condition [0x00007f4be42fc000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at com.szboanda.omcp.upperservice.dataaccess.mqtt.MqttMessageSender.sendMessage(MqttMessageSender.java:187)
	at com.szboanda.omcp.upperservice.gather.storage.impl.MqttStorer.store(MqttStorer.java:158)
	at com.szboanda.omcp.upperservice.gather.storage.StorageService.storageData(StorageService.java:71)
	at com.szboanda.omcp.upperservice.gather.storage.StorageDataHandler.handle(StorageDataHandler.java:38)
	at com.szboanda.omcp.upperservice.gather.ChainStepManager.doChainHandle(ChainStepManager.java:118)
	at com.szboanda.omcp.upperservice.protocol.hjt212.command.impl.classify.MonitorDataCommand.action(MonitorDataCommand.java:36)
	at com.szboanda.omcp.upperservice.protocol.hjt212.HJT212Protocol.processData(HJT212Protocol.java:143)
	at com.szboanda.omcp.upperservice.dataprocess.concurrent.DataProcessRunnable.run(DataProcessRunnable.java:41)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperDataProcess-6" #147018 prio=5 os_prio=0 tid=0x00007f4bfc022000 nid=0x4320 waiting on condition [0x00007f4bd89fa000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at com.szboanda.omcp.upperservice.dataaccess.mqtt.MqttMessageSender.sendMessage(MqttMessageSender.java:187)
	at com.szboanda.omcp.upperservice.gather.storage.impl.MqttStorer.store(MqttStorer.java:158)
	at com.szboanda.omcp.upperservice.gather.storage.StorageService.storageData(StorageService.java:71)
	at com.szboanda.omcp.upperservice.gather.storage.StorageDataHandler.handle(StorageDataHandler.java:38)
	at com.szboanda.omcp.upperservice.gather.ChainStepManager.doChainHandle(ChainStepManager.java:118)
	at com.szboanda.omcp.upperservice.protocol.hjt212.command.impl.classify.MonitorDataCommand.action(MonitorDataCommand.java:36)
	at com.szboanda.omcp.upperservice.protocol.hjt212.HJT212Protocol.processData(HJT212Protocol.java:143)
	at com.szboanda.omcp.upperservice.dataprocess.concurrent.DataProcessRunnable.run(DataProcessRunnable.java:41)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"MQTT Reconnect: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_hjt212" #140121 prio=5 os_prio=0 tid=0x00007f4c380b0800 nid=0x282f in Object.wait() [0x00007f4bdeffd000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at java.util.TimerThread.mainLoop(Timer.java:526)
	- locked <0x00000006ceba9408> (a java.util.TaskQueue)
	at java.util.TimerThread.run(Timer.java:505)

"MQTT Reconnect: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_hjt212" #137762 prio=5 os_prio=0 tid=0x00007f4c54028800 nid=0x1ef8 in Object.wait() [0x00007f4bd82fa000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at java.util.TimerThread.mainLoop(Timer.java:526)
	- locked <0x00000006ceaeb408> (a java.util.TaskQueue)
	at java.util.TimerThread.run(Timer.java:505)

"MQTT Reconnect: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_hjt212" #136279 prio=5 os_prio=0 tid=0x00007f4c30006800 nid=0x192d in Object.wait() [0x00007f4bdeefd000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at java.util.TimerThread.mainLoop(Timer.java:526)
	- locked <0x00000006cea55408> (a java.util.TaskQueue)
	at java.util.TimerThread.run(Timer.java:505)

"MQTT Reconnect: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_hjt212" #135379 prio=5 os_prio=0 tid=0x00007f4c1c014000 nid=0x15a9 in Object.wait() [0x00007f4bdedfd000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at java.util.TimerThread.mainLoop(Timer.java:526)
	- locked <0x00000006cea1b408> (a java.util.TaskQueue)
	at java.util.TimerThread.run(Timer.java:505)

"MQTT Reconnect: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_hjt212" #135079 prio=5 os_prio=0 tid=0x00007f4bec00c000 nid=0x147d in Object.wait() [0x00007f4be41fc000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at java.util.TimerThread.mainLoop(Timer.java:526)
	- locked <0x00000006cea03408> (a java.util.TaskQueue)
	at java.util.TimerThread.run(Timer.java:505)

"MQTT Reconnect: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_hjt212" #133494 prio=5 os_prio=0 tid=0x00007f4c2400d800 nid=0xe4c in Object.wait() [0x00007f4be43fc000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at java.util.TimerThread.mainLoop(Timer.java:526)
	- locked <0x00000006ce963408> (a java.util.TaskQueue)
	at java.util.TimerThread.run(Timer.java:505)

"MQTT Reconnect: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_hjt212" #130054 prio=5 os_prio=0 tid=0x00007f4be000f800 nid=0x7faf in Object.wait() [0x00007f4bd8afa000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at java.util.TimerThread.mainLoop(Timer.java:526)
	- locked <0x00000006ce81d7a0> (a java.util.TaskQueue)
	at java.util.TimerThread.run(Timer.java:505)

"MQTT Reconnect: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_hjt212" #98856 prio=5 os_prio=0 tid=0x00007f4be8025000 nid=0x5d0 in Object.wait() [0x00007f4bd85fa000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at java.util.TimerThread.mainLoop(Timer.java:526)
	- locked <0x00000006cdd8b9e0> (a java.util.TaskQueue)
	at java.util.TimerThread.run(Timer.java:505)

"Okio Watchdog" #22716 daemon prio=5 os_prio=0 tid=0x00007f4c20028000 nid=0x58d5 in Object.wait() [0x00007f4bd87fa000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:460)
	at okio.AsyncTimeout.awaitTimeout(AsyncTimeout.java:361)
	at okio.AsyncTimeout$Watchdog.run(AsyncTimeout.java:312)
	- locked <0x00000006c84a95e0> (a java.lang.Class for okio.AsyncTimeout)

"MQTT Ping: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_day" #115 prio=5 os_prio=0 tid=0x00007f4c1800b000 nid=0x8c in Object.wait() [0x00007f4bd8ffa000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.util.TimerThread.mainLoop(Timer.java:552)
	- locked <0x00000006c8a2d948> (a java.util.TaskQueue)
	at java.util.TimerThread.run(Timer.java:505)

"MQTT Call: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_day" #114 prio=5 os_prio=0 tid=0x00007f4c1c00f800 nid=0x8b in Object.wait() [0x00007f4bd8cfa000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at org.eclipse.paho.mqttv5.client.internal.CommsCallback.run(CommsCallback.java:192)
	- locked <0x00000006c8a2ee10> (a java.lang.Object)
	at java.lang.Thread.run(Thread.java:748)

"MQTT Snd: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_day" #113 prio=5 os_prio=0 tid=0x00007f4c1c0fe000 nid=0x8a in Object.wait() [0x00007f4bd8dfa000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at org.eclipse.paho.mqttv5.client.internal.ClientState.get(ClientState.java:833)
	- locked <0x00000006c8a2ee30> (a java.lang.Object)
	at org.eclipse.paho.mqttv5.client.internal.CommsSender.run(CommsSender.java:130)
	at java.lang.Thread.run(Thread.java:748)

"MQTT Rec: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_day" #112 prio=5 os_prio=0 tid=0x00007f4c1c0fd800 nid=0x89 runnable [0x00007f4bd8efa000]
   java.lang.Thread.State: RUNNABLE
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:171)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at java.net.SocketInputStream.read(SocketInputStream.java:224)
	at java.io.DataInputStream.readByte(DataInputStream.java:265)
	at org.eclipse.paho.mqttv5.client.wire.MqttInputStream.readMqttWireMessage(MqttInputStream.java:96)
	at org.eclipse.paho.mqttv5.client.internal.CommsReceiver.run(CommsReceiver.java:139)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperReverseCtr-2" #110 prio=5 os_prio=0 tid=0x00007f4c10009000 nid=0x87 waiting on condition [0x00007f4bd92fa000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c897bfb0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"MQTT Ping: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_spanVerification" #109 prio=5 os_prio=0 tid=0x00007f4c0000b000 nid=0x86 in Object.wait() [0x00007f4bd96fa000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.util.TimerThread.mainLoop(Timer.java:552)
	- locked <0x00000006c89ae168> (a java.util.TaskQueue)
	at java.util.TimerThread.run(Timer.java:505)

"MQTT Call: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_spanVerification" #108 prio=5 os_prio=0 tid=0x00007f4c0405f800 nid=0x85 in Object.wait() [0x00007f4bd93fa000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at org.eclipse.paho.mqttv5.client.internal.CommsCallback.run(CommsCallback.java:192)
	- locked <0x00000006c89af900> (a java.lang.Object)
	at java.lang.Thread.run(Thread.java:748)

"MQTT Snd: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_spanVerification" #107 prio=5 os_prio=0 tid=0x00007f4c0405e000 nid=0x84 in Object.wait() [0x00007f4bd94fa000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at org.eclipse.paho.mqttv5.client.internal.ClientState.get(ClientState.java:833)
	- locked <0x00000006c89af920> (a java.lang.Object)
	at org.eclipse.paho.mqttv5.client.internal.CommsSender.run(CommsSender.java:130)
	at java.lang.Thread.run(Thread.java:748)

"MQTT Rec: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_spanVerification" #106 prio=5 os_prio=0 tid=0x00007f4c04054800 nid=0x83 runnable [0x00007f4bd95fa000]
   java.lang.Thread.State: RUNNABLE
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:171)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at java.net.SocketInputStream.read(SocketInputStream.java:224)
	at java.io.DataInputStream.readByte(DataInputStream.java:265)
	at org.eclipse.paho.mqttv5.client.wire.MqttInputStream.readMqttWireMessage(MqttInputStream.java:96)
	at org.eclipse.paho.mqttv5.client.internal.CommsReceiver.run(CommsReceiver.java:139)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperReverseCtr-1" #104 prio=5 os_prio=0 tid=0x00007f4c10006000 nid=0x81 waiting on condition [0x00007f4bd97fa000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c897bfb0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"MQTT Ping: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_zeroVerification" #103 prio=5 os_prio=0 tid=0x00007f4be801b000 nid=0x80 in Object.wait() [0x00007f4bd9bfa000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.util.TimerThread.mainLoop(Timer.java:552)
	- locked <0x00000006c899d920> (a java.util.TaskQueue)
	at java.util.TimerThread.run(Timer.java:505)

"MQTT Call: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_zeroVerification" #102 prio=5 os_prio=0 tid=0x00007f4bec007800 nid=0x7f in Object.wait() [0x00007f4bd98fa000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at org.eclipse.paho.mqttv5.client.internal.CommsCallback.run(CommsCallback.java:192)
	- locked <0x00000006c899eeb8> (a java.lang.Object)
	at java.lang.Thread.run(Thread.java:748)

"MQTT Snd: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_zeroVerification" #101 prio=5 os_prio=0 tid=0x00007f4bec005800 nid=0x7e in Object.wait() [0x00007f4bd99fa000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at org.eclipse.paho.mqttv5.client.internal.ClientState.get(ClientState.java:833)
	- locked <0x00000006c899eed8> (a java.lang.Object)
	at org.eclipse.paho.mqttv5.client.internal.CommsSender.run(CommsSender.java:130)
	at java.lang.Thread.run(Thread.java:748)

"MQTT Rec: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_zeroVerification" #100 prio=5 os_prio=0 tid=0x00007f4bec004000 nid=0x7d runnable [0x00007f4bd9afa000]
   java.lang.Thread.State: RUNNABLE
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:171)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at java.net.SocketInputStream.read(SocketInputStream.java:224)
	at java.io.DataInputStream.readByte(DataInputStream.java:265)
	at org.eclipse.paho.mqttv5.client.wire.MqttInputStream.readMqttWireMessage(MqttInputStream.java:96)
	at org.eclipse.paho.mqttv5.client.internal.CommsReceiver.run(CommsReceiver.java:139)
	at java.lang.Thread.run(Thread.java:748)

"logback-2" #98 daemon prio=5 os_prio=0 tid=0x00007f4c24008000 nid=0x7b waiting on condition [0x00007f4bd9cfa000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c7c36fa0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"pool-11-thread-1" #97 prio=5 os_prio=0 tid=0x00007f4c20014800 nid=0x7a waiting on condition [0x00007f4bd9ffa000]
   java.lang.Thread.State: TIMED_WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c85a8b08> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"MQTT Ping: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_minute" #96 prio=5 os_prio=0 tid=0x00007f4c5800e800 nid=0x79 in Object.wait() [0x00007f4bdc3fc000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.util.TimerThread.mainLoop(Timer.java:552)
	- locked <0x00000006c8542cf0> (a java.util.TaskQueue)
	at java.util.TimerThread.run(Timer.java:505)

"MQTT Call: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_minute" #95 prio=5 os_prio=0 tid=0x00007f4c4c006000 nid=0x78 in Object.wait() [0x00007f4bdc0fc000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at org.eclipse.paho.mqttv5.client.internal.CommsCallback.run(CommsCallback.java:192)
	- locked <0x00000006c8542708> (a java.lang.Object)
	at java.lang.Thread.run(Thread.java:748)

"MQTT Snd: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_minute" #94 prio=5 os_prio=0 tid=0x00007f4c4c004000 nid=0x77 in Object.wait() [0x00007f4bdc1fc000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at org.eclipse.paho.mqttv5.client.internal.ClientState.get(ClientState.java:833)
	- locked <0x00000006c8542a88> (a java.lang.Object)
	at org.eclipse.paho.mqttv5.client.internal.CommsSender.run(CommsSender.java:130)
	at java.lang.Thread.run(Thread.java:748)

"MQTT Rec: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_minute" #93 prio=5 os_prio=0 tid=0x00007f4c4c002800 nid=0x76 runnable [0x00007f4bdc2fc000]
   java.lang.Thread.State: RUNNABLE
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:171)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at java.net.SocketInputStream.read(SocketInputStream.java:224)
	at java.io.DataInputStream.readByte(DataInputStream.java:265)
	at org.eclipse.paho.mqttv5.client.wire.MqttInputStream.readMqttWireMessage(MqttInputStream.java:96)
	at org.eclipse.paho.mqttv5.client.internal.CommsReceiver.run(CommsReceiver.java:139)
	at java.lang.Thread.run(Thread.java:748)

"MQTT Ping: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_failed" #91 prio=5 os_prio=0 tid=0x00007f4c3c002000 nid=0x74 in Object.wait() [0x00007f4bdc7fc000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.util.TimerThread.mainLoop(Timer.java:552)
	- locked <0x00000006c853ab18> (a java.util.TaskQueue)
	at java.util.TimerThread.run(Timer.java:505)

"MQTT Call: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_failed" #90 prio=5 os_prio=0 tid=0x00007f4c40095800 nid=0x73 in Object.wait() [0x00007f4bdc4fc000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at org.eclipse.paho.mqttv5.client.internal.CommsCallback.run(CommsCallback.java:192)
	- locked <0x00000006c853a4e0> (a java.lang.Object)
	at java.lang.Thread.run(Thread.java:748)

"MQTT Snd: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_failed" #89 prio=5 os_prio=0 tid=0x00007f4c40094000 nid=0x72 in Object.wait() [0x00007f4bdc5fc000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at org.eclipse.paho.mqttv5.client.internal.ClientState.get(ClientState.java:833)
	- locked <0x00000006c853a860> (a java.lang.Object)
	at org.eclipse.paho.mqttv5.client.internal.CommsSender.run(CommsSender.java:130)
	at java.lang.Thread.run(Thread.java:748)

"MQTT Rec: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_failed" #88 prio=5 os_prio=0 tid=0x00007f4c4042c000 nid=0x71 runnable [0x00007f4bdc6fc000]
   java.lang.Thread.State: RUNNABLE
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:171)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at java.net.SocketInputStream.read(SocketInputStream.java:224)
	at java.io.DataInputStream.readByte(DataInputStream.java:265)
	at org.eclipse.paho.mqttv5.client.wire.MqttInputStream.readMqttWireMessage(MqttInputStream.java:96)
	at org.eclipse.paho.mqttv5.client.internal.CommsReceiver.run(CommsReceiver.java:139)
	at java.lang.Thread.run(Thread.java:748)

"MQTT Ping: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_dataES" #86 prio=5 os_prio=0 tid=0x00007f4c30002000 nid=0x6f in Object.wait() [0x00007f4bdcbfc000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.util.TimerThread.mainLoop(Timer.java:552)
	- locked <0x00000006c852d5a0> (a java.util.TaskQueue)
	at java.util.TimerThread.run(Timer.java:505)

"MQTT Call: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_dataES" #85 prio=5 os_prio=0 tid=0x00007f4c24006800 nid=0x6e in Object.wait() [0x00007f4bdc8fc000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at org.eclipse.paho.mqttv5.client.internal.CommsCallback.run(CommsCallback.java:192)
	- locked <0x00000006c852cfb8> (a java.lang.Object)
	at java.lang.Thread.run(Thread.java:748)

"MQTT Snd: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_dataES" #84 prio=5 os_prio=0 tid=0x00007f4c24005000 nid=0x6d in Object.wait() [0x00007f4bdc9fc000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at org.eclipse.paho.mqttv5.client.internal.ClientState.get(ClientState.java:833)
	- locked <0x00000006c852d338> (a java.lang.Object)
	at org.eclipse.paho.mqttv5.client.internal.CommsSender.run(CommsSender.java:130)
	at java.lang.Thread.run(Thread.java:748)

"MQTT Rec: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_dataES" #83 prio=5 os_prio=0 tid=0x00007f4c24003000 nid=0x6c runnable [0x00007f4bdcafc000]
   java.lang.Thread.State: RUNNABLE
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:171)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at java.net.SocketInputStream.read(SocketInputStream.java:224)
	at java.io.DataInputStream.readByte(DataInputStream.java:265)
	at org.eclipse.paho.mqttv5.client.wire.MqttInputStream.readMqttWireMessage(MqttInputStream.java:96)
	at org.eclipse.paho.mqttv5.client.internal.CommsReceiver.run(CommsReceiver.java:139)
	at java.lang.Thread.run(Thread.java:748)

"MQTT Ping: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_hour" #81 prio=5 os_prio=0 tid=0x00007f4c14142000 nid=0x6a in Object.wait() [0x00007f4bde0fd000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.util.TimerThread.mainLoop(Timer.java:552)
	- locked <0x00000006c8557560> (a java.util.TaskQueue)
	at java.util.TimerThread.run(Timer.java:505)

"MQTT Call: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_hour" #80 prio=5 os_prio=0 tid=0x00007f4c08245800 nid=0x69 in Object.wait() [0x00007f4bddcfd000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at org.eclipse.paho.mqttv5.client.internal.CommsCallback.run(CommsCallback.java:192)
	- locked <0x00000006c8556f30> (a java.lang.Object)
	at java.lang.Thread.run(Thread.java:748)

"MQTT Snd: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_hour" #79 prio=5 os_prio=0 tid=0x00007f4c08244000 nid=0x68 in Object.wait() [0x00007f4bdddfd000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at org.eclipse.paho.mqttv5.client.internal.ClientState.get(ClientState.java:833)
	- locked <0x00000006c85572a8> (a java.lang.Object)
	at org.eclipse.paho.mqttv5.client.internal.CommsSender.run(CommsSender.java:130)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperReverseCtr-5" #78 prio=5 os_prio=0 tid=0x00007f4bf4006000 nid=0x67 waiting on condition [0x00007f4bddefd000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c86a7270> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"MQTT Rec: omcp_publisher_omcp_hjkq_VOC_HJKQ_KQVZ_ZS_SHJ_hour" #77 prio=5 os_prio=0 tid=0x00007f4c08242000 nid=0x66 runnable [0x00007f4bddffd000]
   java.lang.Thread.State: RUNNABLE
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:171)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at java.net.SocketInputStream.read(SocketInputStream.java:224)
	at java.io.DataInputStream.readByte(DataInputStream.java:265)
	at org.eclipse.paho.mqttv5.client.wire.MqttInputStream.readMqttWireMessage(MqttInputStream.java:96)
	at org.eclipse.paho.mqttv5.client.internal.CommsReceiver.run(CommsReceiver.java:139)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperReverseCtr-4" #74 prio=5 os_prio=0 tid=0x00007f4c0404e000 nid=0x63 waiting on condition [0x00007f4bde1fd000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c86a7270> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperReverseCtr-3" #69 prio=5 os_prio=0 tid=0x00007f4bf4003800 nid=0x5e waiting on condition [0x00007f4bde6fd000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c86a7270> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperReverseCtr-2" #68 prio=5 os_prio=0 tid=0x00007f4c04044800 nid=0x5d waiting on condition [0x00007f4bde7fd000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c86a7270> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperReverseCtr-1" #67 prio=5 os_prio=0 tid=0x00007f4bf4001800 nid=0x5c waiting on condition [0x00007f4bde8fd000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c86a7270> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperReverseCtr-0" #66 prio=5 os_prio=0 tid=0x00007f4c04045800 nid=0x5b waiting on condition [0x00007f4bde9fd000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c86a7270> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperSchedule-3" #64 prio=5 os_prio=0 tid=0x00007f4c0823e000 nid=0x59 waiting on condition [0x00007f4bdecfd000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c8582790> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperExtendProcess-7" #57 prio=5 os_prio=0 tid=0x00007f4c00050000 nid=0x52 waiting on condition [0x00007f4be69fd000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c850a0c8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at com.szboanda.omcp.upperservice.gather.processor.invoker.TaskQueue.getTask(TaskQueue.java:47)
	at com.szboanda.omcp.upperservice.gather.processor.invoker.InvokeTaskRunner.run(InvokeTaskRunner.java:30)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperExtendProcess-6" #56 prio=5 os_prio=0 tid=0x00007f4c0004e800 nid=0x51 waiting on condition [0x00007f4be6afd000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c850a0c8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at com.szboanda.omcp.upperservice.gather.processor.invoker.TaskQueue.getTask(TaskQueue.java:47)
	at com.szboanda.omcp.upperservice.gather.processor.invoker.InvokeTaskRunner.run(InvokeTaskRunner.java:30)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperExtendProcess-5" #55 prio=5 os_prio=0 tid=0x00007f4c0004c800 nid=0x50 waiting on condition [0x00007f4be6bfd000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c850a0c8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at com.szboanda.omcp.upperservice.gather.processor.invoker.TaskQueue.getTask(TaskQueue.java:47)
	at com.szboanda.omcp.upperservice.gather.processor.invoker.InvokeTaskRunner.run(InvokeTaskRunner.java:30)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperExtendProcess-4" #54 prio=5 os_prio=0 tid=0x00007f4c0004a800 nid=0x4f waiting on condition [0x00007f4be6cfd000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c850a0c8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at com.szboanda.omcp.upperservice.gather.processor.invoker.TaskQueue.getTask(TaskQueue.java:47)
	at com.szboanda.omcp.upperservice.gather.processor.invoker.InvokeTaskRunner.run(InvokeTaskRunner.java:30)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperExtendProcess-3" #53 prio=5 os_prio=0 tid=0x00007f4c00049000 nid=0x4e waiting on condition [0x00007f4be6dfd000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c850a0c8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at com.szboanda.omcp.upperservice.gather.processor.invoker.TaskQueue.getTask(TaskQueue.java:47)
	at com.szboanda.omcp.upperservice.gather.processor.invoker.InvokeTaskRunner.run(InvokeTaskRunner.java:30)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperExtendProcess-2" #52 prio=5 os_prio=0 tid=0x00007f4c00047000 nid=0x4d waiting on condition [0x00007f4be6efd000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c850a0c8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at com.szboanda.omcp.upperservice.gather.processor.invoker.TaskQueue.getTask(TaskQueue.java:47)
	at com.szboanda.omcp.upperservice.gather.processor.invoker.InvokeTaskRunner.run(InvokeTaskRunner.java:30)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperExtendProcess-1" #51 prio=5 os_prio=0 tid=0x00007f4c00045800 nid=0x4c waiting on condition [0x00007f4be6ffd000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c850a0c8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at com.szboanda.omcp.upperservice.gather.processor.invoker.TaskQueue.getTask(TaskQueue.java:47)
	at com.szboanda.omcp.upperservice.gather.processor.invoker.InvokeTaskRunner.run(InvokeTaskRunner.java:30)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperExtendProcess-0" #50 prio=5 os_prio=0 tid=0x00007f4c00044800 nid=0x4b waiting on condition [0x00007f4c281fd000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c850a0c8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at com.szboanda.omcp.upperservice.gather.processor.invoker.TaskQueue.getTask(TaskQueue.java:47)
	at com.szboanda.omcp.upperservice.gather.processor.invoker.InvokeTaskRunner.run(InvokeTaskRunner.java:30)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"pool-9-thread-1" #49 prio=5 os_prio=0 tid=0x00007f4c0003f000 nid=0x4a waiting on condition [0x00007f4c282fd000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c850f470> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at com.szboanda.omcp.upperservice.gather.task.ChainDataInfluxSubmissionTask.run(ChainDataInfluxSubmissionTask.java:81)
	at com.szboanda.omcp.upperservice.gather.storage.InfluxDbStorageService.lambda$new$0(InfluxDbStorageService.java:86)
	at com.szboanda.omcp.upperservice.gather.storage.InfluxDbStorageService$$Lambda$29/962691471.run(Unknown Source)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"nioEventLoopGroup-8-1" #48 prio=10 os_prio=0 tid=0x00007f4c1c11b800 nid=0x49 runnable [0x00007f4c283fd000]
   java.lang.Thread.State: RUNNABLE
	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
	- locked <0x00000006c81a3040> (a io.netty.channel.nio.SelectedSelectionKeySet)
	- locked <0x00000006c81a3030> (a java.util.Collections$UnmodifiableSet)
	- locked <0x00000006c81a3058> (a sun.nio.ch.EPollSelectorImpl)
	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
	at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
	at java.lang.Thread.run(Thread.java:748)

"omcpExtendPoolTask-0" #47 prio=5 os_prio=0 tid=0x00007f4c0003b000 nid=0x48 waiting on condition [0x00007f4c284fd000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c8514a98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperSchedule-2" #46 prio=5 os_prio=0 tid=0x00007f4c1412d000 nid=0x47 waiting on condition [0x00007f4c285fd000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c8582790> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperSchedule-1" #45 prio=5 os_prio=0 tid=0x00007f4c0c0ec000 nid=0x46 waiting on condition [0x00007f4c286fd000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c8582790> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperSchedule-0" #44 prio=5 os_prio=0 tid=0x00007f4c0c0eb000 nid=0x45 waiting on condition [0x00007f4c287fd000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c8582790> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"usConnWorkerNioELG-5-8" #43 prio=5 os_prio=0 tid=0x00007f4be8015800 nid=0x44 runnable [0x00007f4c29afe000]
   java.lang.Thread.State: RUNNABLE
	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
	- locked <0x00000006c85e93e8> (a io.netty.channel.nio.SelectedSelectionKeySet)
	- locked <0x00000006c8601a40> (a java.util.Collections$UnmodifiableSet)
	- locked <0x00000006c85e9350> (a sun.nio.ch.EPollSelectorImpl)
	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
	at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
	at java.lang.Thread.run(Thread.java:748)

"usConnWorkerNioELG-5-7" #42 prio=5 os_prio=0 tid=0x00007f4be8014000 nid=0x43 runnable [0x00007f4c29bfe000]
   java.lang.Thread.State: RUNNABLE
	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
	- locked <0x00000006c888f1c0> (a io.netty.channel.nio.SelectedSelectionKeySet)
	- locked <0x00000006c88922e8> (a java.util.Collections$UnmodifiableSet)
	- locked <0x00000006c888f128> (a sun.nio.ch.EPollSelectorImpl)
	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
	at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
	at java.lang.Thread.run(Thread.java:748)

"usConnWorkerNioELG-5-6" #41 prio=5 os_prio=0 tid=0x00007f4be8012000 nid=0x42 runnable [0x00007f4c29cfe000]
   java.lang.Thread.State: RUNNABLE
	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
	- locked <0x00000006c877cb18> (a io.netty.channel.nio.SelectedSelectionKeySet)
	- locked <0x00000006c878be68> (a java.util.Collections$UnmodifiableSet)
	- locked <0x00000006c877cb30> (a sun.nio.ch.EPollSelectorImpl)
	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
	at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
	at java.lang.Thread.run(Thread.java:748)

"usConnWorkerNioELG-5-5" #40 prio=5 os_prio=0 tid=0x00007f4be8010800 nid=0x41 runnable [0x00007f4c29dfe000]
   java.lang.Thread.State: RUNNABLE
	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
	- locked <0x00000006c87c6c38> (a io.netty.channel.nio.SelectedSelectionKeySet)
	- locked <0x00000006c87d49e0> (a java.util.Collections$UnmodifiableSet)
	- locked <0x00000006c87c6c50> (a sun.nio.ch.EPollSelectorImpl)
	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
	at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
	at java.lang.Thread.run(Thread.java:748)

"usConnWorkerNioELG-5-4" #39 prio=5 os_prio=0 tid=0x00007f4be800f000 nid=0x40 runnable [0x00007f4c29efe000]
   java.lang.Thread.State: RUNNABLE
	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
	- locked <0x00000006c866d3c0> (a io.netty.channel.nio.SelectedSelectionKeySet)
	- locked <0x00000006c8681db0> (a java.util.Collections$UnmodifiableSet)
	- locked <0x00000006c866d3d8> (a sun.nio.ch.EPollSelectorImpl)
	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
	at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
	at java.lang.Thread.run(Thread.java:748)

"usConnWorkerNioELG-5-3" #38 prio=5 os_prio=0 tid=0x00007f4be800d000 nid=0x3f runnable [0x00007f4c29ffe000]
   java.lang.Thread.State: RUNNABLE
	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
	- locked <0x00000006c8608160> (a io.netty.channel.nio.SelectedSelectionKeySet)
	- locked <0x00000006c86230f0> (a java.util.Collections$UnmodifiableSet)
	- locked <0x00000006c8608178> (a sun.nio.ch.EPollSelectorImpl)
	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
	at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
	at java.lang.Thread.run(Thread.java:748)

"usConnWorkerNioELG-5-2" #37 prio=5 os_prio=0 tid=0x00007f4be8007000 nid=0x3e runnable [0x00007f4c2a0fe000]
   java.lang.Thread.State: RUNNABLE
	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
	- locked <0x00000006c8874af8> (a io.netty.channel.nio.SelectedSelectionKeySet)
	- locked <0x00000006c8882ec0> (a java.util.Collections$UnmodifiableSet)
	- locked <0x00000006c8882560> (a sun.nio.ch.EPollSelectorImpl)
	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
	at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperConnEvent-5" #36 prio=5 os_prio=0 tid=0x00007f4c0c0b7800 nid=0x3d waiting on condition [0x00007f4c2a1fe000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c85aa968> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at com.szboanda.omcp.upperservice.connect.task.EventTaskQueue.getTask(EventTaskQueue.java:84)
	at com.szboanda.omcp.upperservice.connect.event.ConnectEvent$TaskExectuor.run(ConnectEvent.java:289)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperConnEvent-4" #35 prio=5 os_prio=0 tid=0x00007f4c0c0b5800 nid=0x3c waiting on condition [0x00007f4c2a2fe000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c85aa968> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at com.szboanda.omcp.upperservice.connect.task.EventTaskQueue.getTask(EventTaskQueue.java:84)
	at com.szboanda.omcp.upperservice.connect.event.ConnectEvent$TaskExectuor.run(ConnectEvent.java:289)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperConnEvent-3" #34 prio=5 os_prio=0 tid=0x00007f4c0c0b4000 nid=0x3b waiting on condition [0x00007f4c2a3fe000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c85aa968> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at com.szboanda.omcp.upperservice.connect.task.EventTaskQueue.getTask(EventTaskQueue.java:84)
	at com.szboanda.omcp.upperservice.connect.event.ConnectEvent$TaskExectuor.run(ConnectEvent.java:289)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperConnEvent-2" #33 prio=5 os_prio=0 tid=0x00007f4c0c0b2800 nid=0x3a waiting on condition [0x00007f4c2a4fe000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c85aa968> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at com.szboanda.omcp.upperservice.connect.task.EventTaskQueue.getTask(EventTaskQueue.java:84)
	at com.szboanda.omcp.upperservice.connect.event.ConnectEvent$TaskExectuor.run(ConnectEvent.java:289)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperConnEvent-1" #32 prio=5 os_prio=0 tid=0x00007f4c0c0b1800 nid=0x39 waiting on condition [0x00007f4c2b2fe000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c85aa968> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at com.szboanda.omcp.upperservice.connect.task.EventTaskQueue.getTask(EventTaskQueue.java:84)
	at com.szboanda.omcp.upperservice.connect.event.ConnectEvent$TaskExectuor.run(ConnectEvent.java:289)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperConnEvent-0" #31 prio=5 os_prio=0 tid=0x00007f4c0c0ad800 nid=0x38 waiting on condition [0x00007f4c2b1fe000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c85aa968> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at com.szboanda.omcp.upperservice.connect.task.EventTaskQueue.getTask(EventTaskQueue.java:84)
	at com.szboanda.omcp.upperservice.connect.event.ConnectEvent$TaskExectuor.run(ConnectEvent.java:289)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"usConnWorkerNioELG-5-1" #30 prio=5 os_prio=0 tid=0x00007f4be8005800 nid=0x37 runnable [0x00007f4c2b0fe000]
   java.lang.Thread.State: RUNNABLE
	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
	- locked <0x00000006c86aeed8> (a io.netty.channel.nio.SelectedSelectionKeySet)
	- locked <0x00000006c86c8b30> (a java.util.Collections$UnmodifiableSet)
	- locked <0x00000006c86aeef0> (a sun.nio.ch.EPollSelectorImpl)
	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
	at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
	at java.lang.Thread.run(Thread.java:748)

"usWsBossNioELG-1-1" #29 prio=5 os_prio=0 tid=0x00007f4c0c09c000 nid=0x36 runnable [0x00007f4c2a5fe000]
   java.lang.Thread.State: RUNNABLE
	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
	- locked <0x00000006c822f6e0> (a io.netty.channel.nio.SelectedSelectionKeySet)
	- locked <0x00000006c822f6d0> (a java.util.Collections$UnmodifiableSet)
	- locked <0x00000006c822f6f8> (a sun.nio.ch.EPollSelectorImpl)
	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
	at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
	at java.lang.Thread.run(Thread.java:748)

"usHttpBossNioELG-2-1" #28 prio=5 os_prio=0 tid=0x00007f4c0810b800 nid=0x35 runnable [0x00007f4c2a6fe000]
   java.lang.Thread.State: RUNNABLE
	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
	- locked <0x00000006c820faa8> (a io.netty.channel.nio.SelectedSelectionKeySet)
	- locked <0x00000006c820fa98> (a java.util.Collections$UnmodifiableSet)
	- locked <0x00000006c820fac0> (a sun.nio.ch.EPollSelectorImpl)
	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
	at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
	at java.lang.Thread.run(Thread.java:748)

"usConnBossNioELG-3-1" #27 prio=5 os_prio=0 tid=0x00007f4c1412f000 nid=0x34 runnable [0x00007f4c2a7fe000]
   java.lang.Thread.State: RUNNABLE
	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
	- locked <0x00000006c85bc5c0> (a io.netty.channel.nio.SelectedSelectionKeySet)
	- locked <0x00000006c85bd698> (a java.util.Collections$UnmodifiableSet)
	- locked <0x00000006c85bc518> (a sun.nio.ch.EPollSelectorImpl)
	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
	at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
	at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
	at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
	at java.lang.Thread.run(Thread.java:748)

"DestroyJavaVM" #26 prio=5 os_prio=0 tid=0x00007f4c7c009000 nid=0x18 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"omcpUpperDataProcess-5" #24 prio=5 os_prio=0 tid=0x00007f4c7ca5a800 nid=0x33 waiting on condition [0x00007f4c2aafe000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at com.szboanda.omcp.upperservice.dataaccess.mqtt.MqttMessageSender.sendMessage(MqttMessageSender.java:187)
	at com.szboanda.omcp.upperservice.gather.storage.impl.MqttStorer.store(MqttStorer.java:158)
	at com.szboanda.omcp.upperservice.gather.storage.StorageService.storageProtocolData(StorageService.java:149)
	at com.szboanda.omcp.upperservice.protocol.hjt212.action.CommonStorageAction.storageData(CommonStorageAction.java:66)
	at com.szboanda.omcp.upperservice.protocol.hjt212.command.AbstractCommand.action(AbstractCommand.java:91)
	at com.szboanda.omcp.upperservice.protocol.hjt212.HJT212Protocol.processData(HJT212Protocol.java:143)
	at com.szboanda.omcp.upperservice.dataprocess.concurrent.DataProcessRunnable.run(DataProcessRunnable.java:41)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperDataProcess-4" #23 prio=5 os_prio=0 tid=0x00007f4c7ca58800 nid=0x32 waiting on condition [0x00007f4c2abfe000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at com.szboanda.omcp.upperservice.dataaccess.mqtt.MqttMessageSender.sendMessage(MqttMessageSender.java:187)
	at com.szboanda.omcp.upperservice.gather.storage.impl.MqttStorer.store(MqttStorer.java:158)
	at com.szboanda.omcp.upperservice.gather.storage.StorageService.storageData(StorageService.java:71)
	at com.szboanda.omcp.upperservice.gather.storage.StorageDataHandler.handle(StorageDataHandler.java:38)
	at com.szboanda.omcp.upperservice.gather.ChainStepManager.doChainHandle(ChainStepManager.java:118)
	at com.szboanda.omcp.upperservice.protocol.hjt212.command.impl.classify.MonitorDataCommand.action(MonitorDataCommand.java:36)
	at com.szboanda.omcp.upperservice.protocol.hjt212.HJT212Protocol.processData(HJT212Protocol.java:143)
	at com.szboanda.omcp.upperservice.dataprocess.concurrent.DataProcessRunnable.run(DataProcessRunnable.java:41)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperDataProcess-3" #22 prio=5 os_prio=0 tid=0x00007f4c7ca57000 nid=0x31 waiting on condition [0x00007f4c2acfe000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at com.szboanda.omcp.upperservice.dataaccess.mqtt.MqttMessageSender.sendMessage(MqttMessageSender.java:187)
	at com.szboanda.omcp.upperservice.gather.storage.impl.MqttStorer.store(MqttStorer.java:158)
	at com.szboanda.omcp.upperservice.gather.storage.StorageService.storageProtocolData(StorageService.java:149)
	at com.szboanda.omcp.upperservice.protocol.hjt212.action.CommonStorageAction.storageData(CommonStorageAction.java:66)
	at com.szboanda.omcp.upperservice.protocol.hjt212.command.AbstractCommand.action(AbstractCommand.java:91)
	at com.szboanda.omcp.upperservice.protocol.hjt212.HJT212Protocol.processData(HJT212Protocol.java:143)
	at com.szboanda.omcp.upperservice.dataprocess.concurrent.DataProcessRunnable.run(DataProcessRunnable.java:41)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperDataProcess-2" #21 prio=5 os_prio=0 tid=0x00007f4c7ca55000 nid=0x30 waiting on condition [0x00007f4c2adfe000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at com.szboanda.omcp.upperservice.dataaccess.mqtt.MqttMessageSender.sendMessage(MqttMessageSender.java:187)
	at com.szboanda.omcp.upperservice.gather.storage.impl.MqttStorer.store(MqttStorer.java:158)
	at com.szboanda.omcp.upperservice.gather.storage.StorageService.storageData(StorageService.java:71)
	at com.szboanda.omcp.upperservice.gather.storage.StorageDataHandler.handle(StorageDataHandler.java:38)
	at com.szboanda.omcp.upperservice.gather.ChainStepManager.doChainHandle(ChainStepManager.java:118)
	at com.szboanda.omcp.upperservice.protocol.hjt212.command.impl.classify.MonitorDataCommand.action(MonitorDataCommand.java:36)
	at com.szboanda.omcp.upperservice.protocol.hjt212.HJT212Protocol.processData(HJT212Protocol.java:143)
	at com.szboanda.omcp.upperservice.dataprocess.concurrent.DataProcessRunnable.run(DataProcessRunnable.java:41)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperDataProcess-1" #20 prio=5 os_prio=0 tid=0x00007f4c7ca53800 nid=0x2f waiting on condition [0x00007f4c2aefe000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at com.szboanda.omcp.upperservice.dataaccess.mqtt.MqttMessageSender.sendMessage(MqttMessageSender.java:187)
	at com.szboanda.omcp.upperservice.gather.storage.impl.MqttStorer.store(MqttStorer.java:158)
	at com.szboanda.omcp.upperservice.gather.storage.StorageService.storageData(StorageService.java:71)
	at com.szboanda.omcp.upperservice.gather.storage.StorageDataHandler.handle(StorageDataHandler.java:38)
	at com.szboanda.omcp.upperservice.gather.ChainStepManager.doChainHandle(ChainStepManager.java:118)
	at com.szboanda.omcp.upperservice.protocol.hjt212.command.impl.classify.MonitorDataCommand.action(MonitorDataCommand.java:36)
	at com.szboanda.omcp.upperservice.protocol.hjt212.HJT212Protocol.processData(HJT212Protocol.java:143)
	at com.szboanda.omcp.upperservice.dataprocess.concurrent.DataProcessRunnable.run(DataProcessRunnable.java:41)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperDataProcess-0" #19 prio=5 os_prio=0 tid=0x00007f4c7ca52000 nid=0x2e waiting on condition [0x00007f4c2affe000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at com.szboanda.omcp.upperservice.dataaccess.mqtt.MqttMessageSender.sendMessage(MqttMessageSender.java:187)
	at com.szboanda.omcp.upperservice.gather.storage.impl.MqttStorer.store(MqttStorer.java:158)
	at com.szboanda.omcp.upperservice.gather.storage.StorageService.storageProtocolData(StorageService.java:149)
	at com.szboanda.omcp.upperservice.protocol.hjt212.action.CommonStorageAction.storageData(CommonStorageAction.java:66)
	at com.szboanda.omcp.upperservice.protocol.hjt212.command.AbstractCommand.action(AbstractCommand.java:91)
	at com.szboanda.omcp.upperservice.protocol.hjt212.HJT212Protocol.processData(HJT212Protocol.java:143)
	at com.szboanda.omcp.upperservice.dataprocess.concurrent.DataProcessRunnable.run(DataProcessRunnable.java:41)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"omcpUpperReverseCtr-0" #15 prio=5 os_prio=0 tid=0x00007f4c7c171000 nid=0x2a waiting on condition [0x00007f4c2b3fe000]
   java.lang.Thread.State: TIMED_WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c897bfb0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"Prototyper" #14 daemon prio=5 os_prio=0 tid=0x00007f4c18005000 nid=0x29 in Object.wait() [0x00007f4c2bbfe000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at org.logicalcobwebs.proxool.PrototyperThread.doWait(PrototyperThread.java:69)
	- locked <0x00000006c7c1bb00> (a org.logicalcobwebs.proxool.PrototyperThread)
	at org.logicalcobwebs.proxool.PrototyperThread.run(PrototyperThread.java:58)

"HouseKeeper" #13 daemon prio=5 os_prio=0 tid=0x00007f4c7c93b800 nid=0x28 waiting on condition [0x00007f4c2bffe000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at org.logicalcobwebs.proxool.HouseKeeperThread.run(HouseKeeperThread.java:46)

"Abandoned connection cleanup thread" #11 daemon prio=5 os_prio=0 tid=0x00007f4c7c8f1000 nid=0x27 in Object.wait() [0x00007f4c601fd000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
	- locked <0x00000006c7c31830> (a java.lang.ref.ReferenceQueue$Lock)
	at com.mysql.cj.jdbc.AbandonedConnectionCleanupThread.run(AbandonedConnectionCleanupThread.java:70)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"logback-1" #9 daemon prio=5 os_prio=0 tid=0x00007f4c7c5a7800 nid=0x26 waiting on condition [0x00007f4c606fd000]
   java.lang.Thread.State: TIMED_WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c7c36fa0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

"Service Thread" #8 daemon prio=9 os_prio=0 tid=0x00007f4c7c0d1800 nid=0x24 runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C1 CompilerThread2" #7 daemon prio=9 os_prio=0 tid=0x00007f4c7c0bc800 nid=0x23 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread1" #6 daemon prio=9 os_prio=0 tid=0x00007f4c7c0ba800 nid=0x22 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread0" #5 daemon prio=9 os_prio=0 tid=0x00007f4c7c0b8000 nid=0x21 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Signal Dispatcher" #4 daemon prio=9 os_prio=0 tid=0x00007f4c7c0b6800 nid=0x20 runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Finalizer" #3 daemon prio=8 os_prio=0 tid=0x00007f4c7c083800 nid=0x1f in Object.wait() [0x00007f4c61c83000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
	- locked <0x00000006c7c38600> (a java.lang.ref.ReferenceQueue$Lock)
	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
	at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)

"Reference Handler" #2 daemon prio=10 os_prio=0 tid=0x00007f4c7c07f000 nid=0x1e in Object.wait() [0x00007f4c61d83000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
	- locked <0x00000006c7c38830> (a java.lang.ref.Reference$Lock)
	at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)

"VM Thread" os_prio=0 tid=0x00007f4c7c077800 nid=0x1d runnable 

"GC task thread#0 (ParallelGC)" os_prio=0 tid=0x00007f4c7c01f000 nid=0x19 runnable 

"GC task thread#1 (ParallelGC)" os_prio=0 tid=0x00007f4c7c020800 nid=0x1a runnable 

"GC task thread#2 (ParallelGC)" os_prio=0 tid=0x00007f4c7c022800 nid=0x1b runnable 

"GC task thread#3 (ParallelGC)" os_prio=0 tid=0x00007f4c7c024000 nid=0x1c runnable 

"VM Periodic Task Thread" os_prio=0 tid=0x00007f4c7c0dc800 nid=0x25 waiting on condition 

JNI global references: 350

MetSystem avatar Dec 11 '24 02:12 MetSystem