2021.11.23 08:57:33 INFO  [hz.openfire.event-2]: org.jivesoftware.openfire.plugin.util.cache.ClusterListener - Received a Hazelcast memberRemoved event MembershipEvent {member=Member [172.60.0.10]:5701 - 10956e89-fc85-4b93-bb24-039cb89a1a18,type=removed} 2021.11.23 08:57:33 INFO  [hz.openfire.cached.thread-4]: com.hazelcast.internal.cluster.ClusterService - [172.60.0.30]:5701 [openfire] [3.12.5] Members {size:1, ver:4} [ Member [172.60.0.30]:5701 - 98de1bb1-6448-4d12-b901-a5ecac93ba30 this ] 2021.11.23 08:57:33 INFO  [hz.openfire.event-2]: org.jivesoftware.openfire.cluster.ClusterManager - Firing left cluster event for another node:f40e4f15-82a7-4a36-8c72-8dd9c4c29a72 2021.11.23 08:57:33 DEBUG [hz.openfire.cached.thread-4]: com.hazelcast.internal.cluster.impl.MembershipManager - [172.60.0.30]:5701 [openfire] [3.12.5] Sending member list to the non-master nodes: Members {size:1, ver:4} [ Member [172.60.0.30]:5701 - 98de1bb1-6448-4d12-b901-a5ecac93ba30 this ] 2021.11.23 08:57:33 INFO  [hz.openfire.event-2]: org.jivesoftware.openfire.cluster.ClusterManager - Firing marked as senior event 2021.11.23 08:57:33 INFO  [hz.openfire.cached.thread-4]: com.hazelcast.internal.cluster.impl.MembershipManager - [172.60.0.30]:5701 [openfire] [3.12.5] Mastership is claimed with: MembersView{version=4, members=[MemberInfo{address=[172.60.0.30]:5701, uuid=98de1bb1-6448-4d12-b901-a5ecac93ba30, liteMember=false, memberListJoinVersion=3}]} 2021.11.23 08:57:33 INFO  [hz.openfire.event-2]: org.jivesoftware.openfire.plugin.util.cache.ClusterListener - Received a Hazelcast memberRemoved event MembershipEvent {member=Member [172.60.0.20]:5701 - cbc56c54-fa22-4865-9a16-5137beea5d39,type=removed} 2021.11.23 08:57:33 INFO  [hz.openfire.event-2]: org.jivesoftware.openfire.cluster.ClusterManager - Firing left cluster event for another node:a8a1a032-497f-461b-87b2-8af2f5dccde5 2021.11.23 08:57:33 INFO  [hz.openfire.cached.thread-5]: com.hazelcast.transaction.TransactionManagerService - [172.60.0.30]:5701 [openfire] [3.12.5] Committing/rolling-back live transactions of [172.60.0.10]:5701, UUID: 10956e89-fc85-4b93-bb24-039cb89a1a18 2021.11.23 08:57:33 WARN  [hz.openfire.cached.thread-6]: com.hazelcast.map.impl.nearcache.invalidation.MemberMapInvalidationMetaDataFetcher - [172.60.0.30]:5701 [openfire] [3.12.5] Can't fetch or extract invalidation meta-data of Member [172.60.0.10]:5701 - 10956e89-fc85-4b93-bb24-039cb89a1a18 com.hazelcast.core.MemberLeftException: Member [172.60.0.10]:5701 - 10956e89-fc85-4b93-bb24-039cb89a1a18 has left cluster! at com.hazelcast.spi.impl.operationservice.impl.InvocationMonitor$OnMemberLeftTask.onTargetLoss(InvocationMonitor.java:424) ~[hazelcast-3.12.5.jar:3.12.5] at com.hazelcast.spi.impl.operationservice.impl.InvocationMonitor$OnMemberLeftTask.run0(InvocationMonitor.java:391) ~[hazelcast-3.12.5.jar:3.12.5] at com.hazelcast.spi.impl.operationservice.impl.InvocationMonitor$MonitorTask.run(InvocationMonitor.java:250) ~[hazelcast-3.12.5.jar:3.12.5] at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[?:?] at java.util.concurrent.FutureTask.run(Unknown Source) ~[?:?] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[?:?] at java.lang.Thread.run(Unknown Source) ~[?:?] at ------ submitted from ------.(Unknown Source) ~[?:?] at com.hazelcast.spi.impl.operationservice.impl.InvocationFuture.resolve(InvocationFuture.java:126) ~[hazelcast-3.12.5.jar:3.12.5] at com.hazelcast.spi.impl.operationservice.impl.InvocationFuture.resolveAndThrowIfException(InvocationFuture.java:79) ~[hazelcast-3.12.5.jar:3.12.5] at com.hazelcast.spi.impl.AbstractInvocationFuture.get(AbstractInvocationFuture.java:191) ~[hazelcast-3.12.5.jar:3.12.5] at com.hazelcast.map.impl.nearcache.invalidation.MemberMapInvalidationMetaDataFetcher.extractMemberMetadata(MemberMapInvalidationMetaDataFetcher.java:68) ~[hazelcast-3.12.5.jar:3.12.5] at com.hazelcast.internal.nearcache.impl.invalidation.InvalidationMetaDataFetcher.processMemberMetadata(InvalidationMetaDataFetcher.java:112) [hazelcast-3.12.5.jar:3.12.5] at com.hazelcast.internal.nearcache.impl.invalidation.InvalidationMetaDataFetcher.fetchMetadata(InvalidationMetaDataFetcher.java:76) [hazelcast-3.12.5.jar:3.12.5] at com.hazelcast.internal.nearcache.impl.invalidation.RepairingTask.runAntiEntropy(RepairingTask.java:152) [hazelcast-3.12.5.jar:3.12.5] at com.hazelcast.internal.nearcache.impl.invalidation.RepairingTask.run(RepairingTask.java:126) [hazelcast-3.12.5.jar:3.12.5] at com.hazelcast.util.executor.CachedExecutorServiceDelegate$Worker.run(CachedExecutorServiceDelegate.java:227) [hazelcast-3.12.5.jar:3.12.5] at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) [?:?] at java.lang.Thread.run(Unknown Source) [?:?] at com.hazelcast.util.executor.HazelcastManagedThread.executeRun(HazelcastManagedThread.java:64) [hazelcast-3.12.5.jar:3.12.5] at com.hazelcast.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:80) [hazelcast-3.12.5.jar:3.12.5] 2021.11.23 08:57:33 INFO  [hz.openfire.cached.thread-5]: com.hazelcast.transaction.TransactionManagerService - [172.60.0.30]:5701 [openfire] [3.12.5] Committing/rolling-back live transactions of [172.60.0.20]:5701, UUID: cbc56c54-fa22-4865-9a16-5137beea5d39 2021.11.23 08:57:33 WARN  [hz.openfire.cached.thread-6]: com.hazelcast.map.impl.nearcache.invalidation.MemberMapInvalidationMetaDataFetcher - [172.60.0.30]:5701 [openfire] [3.12.5] Can't fetch or extract invalidation meta-data of Member [172.60.0.20]:5701 - cbc56c54-fa22-4865-9a16-5137beea5d39 com.hazelcast.core.MemberLeftException: Member [172.60.0.20]:5701 - cbc56c54-fa22-4865-9a16-5137beea5d39 has left cluster! at com.hazelcast.spi.impl.operationservice.impl.InvocationMonitor$OnMemberLeftTask.onTargetLoss(InvocationMonitor.java:424) ~[hazelcast-3.12.5.jar:3.12.5] at com.hazelcast.spi.impl.operationservice.impl.InvocationMonitor$OnMemberLeftTask.run0(InvocationMonitor.java:391) ~[hazelcast-3.12.5.jar:3.12.5] at com.hazelcast.spi.impl.operationservice.impl.InvocationMonitor$MonitorTask.run(InvocationMonitor.java:250) ~[hazelcast-3.12.5.jar:3.12.5] at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[?:?] at java.util.concurrent.FutureTask.run(Unknown Source) ~[?:?] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[?:?] at java.lang.Thread.run(Unknown Source) ~[?:?] at ------ submitted from ------.(Unknown Source) ~[?:?] at com.hazelcast.spi.impl.operationservice.impl.InvocationFuture.resolve(InvocationFuture.java:126) ~[hazelcast-3.12.5.jar:3.12.5] at com.hazelcast.spi.impl.operationservice.impl.InvocationFuture.resolveAndThrowIfException(InvocationFuture.java:79) ~[hazelcast-3.12.5.jar:3.12.5] at com.hazelcast.spi.impl.AbstractInvocationFuture.get(AbstractInvocationFuture.java:179) ~[hazelcast-3.12.5.jar:3.12.5] at com.hazelcast.map.impl.nearcache.invalidation.MemberMapInvalidationMetaDataFetcher.extractMemberMetadata(MemberMapInvalidationMetaDataFetcher.java:68) ~[hazelcast-3.12.5.jar:3.12.5] at com.hazelcast.internal.nearcache.impl.invalidation.InvalidationMetaDataFetcher.processMemberMetadata(InvalidationMetaDataFetcher.java:112) [hazelcast-3.12.5.jar:3.12.5] at com.hazelcast.internal.nearcache.impl.invalidation.InvalidationMetaDataFetcher.fetchMetadata(InvalidationMetaDataFetcher.java:76) [hazelcast-3.12.5.jar:3.12.5] at com.hazelcast.internal.nearcache.impl.invalidation.RepairingTask.runAntiEntropy(RepairingTask.java:152) [hazelcast-3.12.5.jar:3.12.5] at com.hazelcast.internal.nearcache.impl.invalidation.RepairingTask.run(RepairingTask.java:126) [hazelcast-3.12.5.jar:3.12.5] at com.hazelcast.util.executor.CachedExecutorServiceDelegate$Worker.run(CachedExecutorServiceDelegate.java:227) [hazelcast-3.12.5.jar:3.12.5] at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) [?:?] at java.lang.Thread.run(Unknown Source) [?:?] at com.hazelcast.util.executor.HazelcastManagedThread.executeRun(HazelcastManagedThread.java:64) [hazelcast-3.12.5.jar:3.12.5] at com.hazelcast.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:80) [hazelcast-3.12.5.jar:3.12.5] 2021.11.23 08:57:33 INFO  [hz.openfire.migration]: com.hazelcast.internal.partition.InternalPartitionService - [172.60.0.30]:5701 [openfire] [3.12.5] Fetching most recent partition table! my version: 995 2021.11.23 08:57:33 INFO  [hz.openfire.migration]: com.hazelcast.internal.partition.InternalPartitionService - [172.60.0.30]:5701 [openfire] [3.12.5] Most recent partition table version: 995 2021.11.23 08:57:33 DEBUG [hz.openfire.migration]: com.hazelcast.internal.partition.InternalPartitionService - [172.60.0.30]:5701 [openfire] [3.12.5] Publishing partition state, version: 996 2021.11.23 08:57:33 DEBUG [hz.openfire.migration]: com.hazelcast.internal.partition.operation.PromotionCommitOperation - [172.60.0.30]:5701 [openfire] [3.12.5] Submitting BeforePromotionOperations for 180 promotions. Promotion partition state version: 1898, current partition state version: 1538 2021.11.23 08:57:33 DEBUG [hz.openfire.partition-operation.thread-5]: com.hazelcast.internal.partition.operation.PromotionCommitOperation - [172.60.0.30]:5701 [openfire] [3.12.5] All before promotion tasks are completed. 2021.11.23 08:57:33 DEBUG [hz.openfire.priority-generic-operation.thread-0]: com.hazelcast.internal.partition.InternalPartitionService - [172.60.0.30]:5701 [openfire] [3.12.5] Applied partition state update with version: 1898 2021.11.23 08:57:33 DEBUG [hz.openfire.priority-generic-operation.thread-0]: com.hazelcast.internal.partition.operation.PromotionCommitOperation - [172.60.0.30]:5701 [openfire] [3.12.5] Submitting FinalizePromotionOperations for 180 promotions. Result: true. Promotion partition state version: 1898, current partition state version: 1898 2021.11.23 08:57:33 DEBUG [hz.openfire.migration]: com.hazelcast.internal.partition.InternalPartitionService - [172.60.0.30]:5701 [openfire] [3.12.5] Publishing partition state, version: 1898 2021.11.23 08:57:33 DEBUG [hz.openfire.migration]: com.hazelcast.internal.partition.InternalPartitionService - [172.60.0.30]:5701 [openfire] [3.12.5] Publishing partition state, version: 1898 2021.11.23 08:57:33 INFO  [hz.openfire.migration]: com.hazelcast.internal.partition.impl.MigrationManager - [172.60.0.30]:5701 [openfire] [3.12.5] Partition balance is ok, no need to re-partition cluster data... 2021.11.23 08:57:33 DEBUG [Jetty-QTP-AdminConsole-128]: org.jivesoftware.util.CertificateManager - CertificateManager: Subject Alternative Name Mapping returned [xmpp1.localhost.example, xmpp.localhost.example, *.xmpp.localhost.example] 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.muc.spi.MultiUserChatServiceImpl - Cluster event: service conference.xmpp.localhost.example got notified that node f40e4f15-82a7-4a36-8c72-8dd9c4c29a72 left a cluster 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.muc.spi.LocalMUCRoomManager - Looking for rooms that have 'dropped out' of the cache (likely as a result of a network failure). 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.muc.spi.LocalMUCRoomManager - Found 1 rooms that we know locally, but are not (no longer) in the cache. This can occur when a cluster node fails, but should not occur otherwise. Missing rooms: muc2 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.muc.spi.MultiUserChatServiceImpl - Room 'muc2' was lost from the data structure that's shared in the cluster (the cache). This room is now considered 'gone' for this cluster node. Occupants will be informed. 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.muc.spi.MultiUserChatServiceImpl - No chatroom muc2 during removal. 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.muc.spi.MultiUserChatServiceImpl - Going to send 'leave' presence stanzas on the local cluster node for 0 occupant(s) of one or more cluster nodes that are no longer part of our cluster. 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.cluster.ClusterMonitor - Another node (f40e4f15-82a7-4a36-8c72-8dd9c4c29a72/xmpp1.localhost.example (172.60.0.10)) has left the cluster [seniorMember=xmpp3.localhost.example (172.60.0.30)] 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.cluster.ClusterMonitor - Sending message to admins: xmpp1.localhost.example (172.60.0.10) has left the cluster - there is now only 1 node in the cluster (enabled=true) 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Cluster node f40e4f15-82a7-4a36-8c72-8dd9c4c29a72 just left the cluster. 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Looking for local server routes that have 'dropped out' of the cache (likely as a result of a network failure). 2021.11.23 08:57:33 DEBUG [TaskEngine-pool-3]: org.jivesoftware.openfire.XMPPServer - Sending message to admin [jid=admin@xmpp.localhost.example, message=xmpp1.localhost.example (172.60.0.10) has left the cluster - there is now only 1 node in the cluster] 2021.11.23 08:57:33 DEBUG [TaskEngine-pool-3]: org.jivesoftware.openfire.spi.RoutingTableImpl - Unable to route packet. No session is available so store offline. xmpp1.localhost.example (172.60.0.10) has left the cluster - there is now only 1 node in the cluster 2021.11.23 08:57:33 DEBUG [TaskEngine-pool-3]: org.jivesoftware.openfire.spi.RoutingTableImpl - Failed to route packet to JID: admin@xmpp.localhost.example packet: xmpp1.localhost.example (172.60.0.10) has left the cluster - there is now only 1 node in the cluster 2021.11.23 08:57:33 DEBUG [TaskEngine-pool-3]: org.jivesoftware.openfire.MessageRouter - Message sent to unreachable address: xmpp1.localhost.example (172.60.0.10) has left the cluster - there is now only 1 node in the cluster 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Found no local server routes that are missing from the cache. 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Looking for and restoring component routes that have 'dropped out' of the cache (likely as a result of a network failure). 2021.11.23 08:57:33 DEBUG [Jetty-QTP-AdminConsole-128]: org.jivesoftware.openfire.net.DNSUtil - No SRV record found for '_xmpp-client._tcp.xmpp.localhost.example.' javax.naming.NameNotFoundException: DNS name not found [response code 3] at com.sun.jndi.dns.DnsClient.checkResponseCode(Unknown Source) ~[jdk.naming.dns:?] at com.sun.jndi.dns.DnsClient.isMatchResponse(Unknown Source) ~[jdk.naming.dns:?] at com.sun.jndi.dns.DnsClient.doUdpQuery(Unknown Source) ~[jdk.naming.dns:?] at com.sun.jndi.dns.DnsClient.query(Unknown Source) ~[jdk.naming.dns:?] at com.sun.jndi.dns.Resolver.query(Unknown Source) ~[jdk.naming.dns:?] at com.sun.jndi.dns.DnsContext.c_getAttributes(Unknown Source) ~[jdk.naming.dns:?] at com.sun.jndi.toolkit.ctx.ComponentDirContext.p_getAttributes(Unknown Source) ~[?:?] at com.sun.jndi.toolkit.ctx.PartialCompositeDirContext.getAttributes(Unknown Source) ~[?:?] at com.sun.jndi.toolkit.ctx.PartialCompositeDirContext.getAttributes(Unknown Source) ~[?:?] at javax.naming.directory.InitialDirContext.getAttributes(Unknown Source) ~[?:?] at org.jivesoftware.openfire.net.DNSUtil.srvLookup(DNSUtil.java:224) ~[xmppserver-4.7.0-SNAPSHOT.jar:4.7.0-SNAPSHOT] at org.jivesoftware.openfire.admin.index_jsp._jspService(index_jsp.java:402) ~[xmppserver-4.7.0-SNAPSHOT.jar:4.7.0-SNAPSHOT] at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:71) ~[apache-jsp-8.5.54.jar:8.5.54] at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) ~[javax.servlet-api-3.1.0.jar:3.1.0] at org.eclipse.jetty.servlet.ServletHolder$NotAsync.service(ServletHolder.java:1459) ~[jetty-servlet-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799) ~[jetty-servlet-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1626) ~[jetty-servlet-9.4.43.v20210629.jar:9.4.43.v20210629] at com.opensymphony.sitemesh.webapp.SiteMeshFilter.obtainContent(SiteMeshFilter.java:129) ~[sitemesh-2.4.2.jar:?] at com.opensymphony.sitemesh.webapp.SiteMeshFilter.doFilter(SiteMeshFilter.java:77) ~[sitemesh-2.4.2.jar:?] at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) ~[jetty-servlet-9.4.43.v20210629.jar:9.4.43.v20210629] at org.jivesoftware.util.LocaleFilter.doFilter(LocaleFilter.java:73) ~[xmppserver-4.7.0-SNAPSHOT.jar:4.7.0-SNAPSHOT] at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) ~[jetty-servlet-9.4.43.v20210629.jar:9.4.43.v20210629] at org.jivesoftware.util.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:49) ~[xmppserver-4.7.0-SNAPSHOT.jar:4.7.0-SNAPSHOT] at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) ~[jetty-servlet-9.4.43.v20210629.jar:9.4.43.v20210629] at org.jivesoftware.admin.PluginFilter.doFilter(PluginFilter.java:226) ~[xmppserver-4.7.0-SNAPSHOT.jar:4.7.0-SNAPSHOT] at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) ~[jetty-servlet-9.4.43.v20210629.jar:9.4.43.v20210629] at org.jivesoftware.admin.AuthCheckFilter.doFilter(AuthCheckFilter.java:234) ~[xmppserver-4.7.0-SNAPSHOT.jar:4.7.0-SNAPSHOT] at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:201) ~[jetty-servlet-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) ~[jetty-servlet-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548) ~[jetty-servlet-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) ~[jetty-server-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) ~[jetty-security-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) ~[jetty-server-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) ~[jetty-server-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624) ~[jetty-server-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) ~[jetty-server-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434) ~[jetty-server-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) ~[jetty-server-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501) ~[jetty-servlet-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594) ~[jetty-server-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) ~[jetty-server-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349) ~[jetty-server-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) ~[jetty-server-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:191) ~[jetty-server-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) ~[jetty-server-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) ~[jetty-server-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.server.Server.handle(Server.java:516) ~[jetty-server-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:388) ~[jetty-server-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:633) [jetty-server-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:380) [jetty-server-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277) [jetty-server-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) [jetty-io-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) [jetty-io-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) [jetty-io-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338) [jetty-util-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315) [jetty-util-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173) [jetty-util-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131) [jetty-util-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:386) [jetty-util-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) [jetty-util-9.4.43.v20210629.jar:9.4.43.v20210629] at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) [jetty-util-9.4.43.v20210629.jar:9.4.43.v20210629] at java.lang.Thread.run(Unknown Source) [?:?] 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Looking for local (non-anonymous) client routes that have 'dropped out' of the cache (likely as a result of a network failure). 2021.11.23 08:57:33 WARN  [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Found 1 (non-anonymous) user routes that we know locally, but are not (no longer) in the cache. This can occur when a cluster node fails, but should not occur otherwise. 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Restoring (non-anonymous) user routes: user2@xmpp.localhost.example/Spark 2.9.4 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Adding client route user2@xmpp.localhost.example/Spark 2.9.4 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Adding client route ClientRoute{nodeID=fbd124d0-af36-4f74-b319-36143f21cd7b, available=true} to users cache under key user2@xmpp.localhost.example/Spark 2.9.4 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Looking for local (non-anonymous) client routes that have 'dropped out' of the cache (likely as a result of a network failure). 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Found no local anonymous user routes that are missing from the cache. 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Cluster node f40e4f15-82a7-4a36-8c72-8dd9c4c29a72 just left the cluster. A total of 0 outgoing server sessions was living there, and are no longer available. 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Removing node 'f40e4f15-82a7-4a36-8c72-8dd9c4c29a72' from componentsByClusteredNode: [component.xmpp.localhost.example, proxy.xmpp.localhost.example, conference.xmpp.localhost.example, pubsub.xmpp.localhost.example] 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Cluster node f40e4f15-82a7-4a36-8c72-8dd9c4c29a72 just left the cluster. A total of 0 component sessions is now no longer available as a result. 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Cluster node f40e4f15-82a7-4a36-8c72-8dd9c4c29a72 just left the cluster. A total of 0 client routes was living there, and are no longer available. 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Restoring Users Sessions Cache 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.SessionManager - Cluster node f40e4f15-82a7-4a36-8c72-8dd9c4c29a72 just left the cluster. 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.SessionManager - Looking for local ClientSessionInfo instances that have 'dropped out' of the cache (likely as a result of a network failure). 2021.11.23 08:57:33 WARN  [ClusterManager events dispatcher]: org.jivesoftware.openfire.SessionManager - Found 1 ClientSessionInfo instances that we know locally, but are not (no longer) in the cache. This can occur when a cluster node fails, but should not occur otherwise. 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.SessionManager - Restoring ClientSessionInfo instances for: user2@xmpp.localhost.example/Spark 2.9.4 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.SessionManager - Looking for local component sessions that have 'dropped out' of the cache (likely as a result of a network failure). 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.SessionManager - Found no local component sessions that are missing from the cache. 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.SessionManager - Skip looking for local connection manager sessions that have 'dropped out' of the cache (likely as a result of a network failure), as these deprecated mechanisms aren't supported anymore. 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.SessionManager - Looking for local incoming server sessions that have 'dropped out' of the cache (likely as a result of a network failure). 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.SessionManager - Found no local incoming server sessions that are missing from the cache. 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.SessionManager - Looking for local domain sessions that have 'dropped out' of the cache (likely as a result of a network failure). 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.SessionManager - Found no local domain sessions that are missing from the cache. 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.handler.PresenceUpdateHandler - Remove traces of directed presences sent from node 'f40e4f15-82a7-4a36-8c72-8dd9c4c29a72' that is gone to entities hosted in this JVM. 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.muc.spi.MultiUserChatServiceImpl - Cluster event: service conference.xmpp.localhost.example got notified that it is now the senior cluster member 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.cluster.ClusterMonitor - This node (fbd124d0-af36-4f74-b319-36143f21cd7b/xmpp3.localhost.example) is now the senior member 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.muc.spi.MultiUserChatServiceImpl - Cluster event: service conference.xmpp.localhost.example got notified that node a8a1a032-497f-461b-87b2-8af2f5dccde5 left a cluster 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.muc.spi.LocalMUCRoomManager - Looking for rooms that have 'dropped out' of the cache (likely as a result of a network failure). 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.muc.spi.LocalMUCRoomManager - Found no rooms that are missing from the cache. 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.muc.spi.MultiUserChatServiceImpl - Going to send 'leave' presence stanzas on the local cluster node for 0 occupant(s) of one or more cluster nodes that are no longer part of our cluster. 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.cluster.ClusterMonitor - Another node (a8a1a032-497f-461b-87b2-8af2f5dccde5/xmpp2.localhost.example (172.60.0.20)) has left the cluster [seniorMember=xmpp3.localhost.example (172.60.0.30)] 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.cluster.ClusterMonitor - Sending message to admins: xmpp2.localhost.example (172.60.0.20) has left the cluster - there is now only 1 node in the cluster (enabled=true) 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Cluster node a8a1a032-497f-461b-87b2-8af2f5dccde5 just left the cluster. 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Looking for local server routes that have 'dropped out' of the cache (likely as a result of a network failure). 2021.11.23 08:57:33 DEBUG [TaskEngine-pool-3]: org.jivesoftware.openfire.XMPPServer - Sending message to admin [jid=admin@xmpp.localhost.example, message=xmpp2.localhost.example (172.60.0.20) has left the cluster - there is now only 1 node in the cluster] 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Found no local server routes that are missing from the cache. 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Looking for and restoring component routes that have 'dropped out' of the cache (likely as a result of a network failure). 2021.11.23 08:57:33 DEBUG [TaskEngine-pool-3]: org.jivesoftware.openfire.spi.RoutingTableImpl - Unable to route packet. No session is available so store offline. xmpp2.localhost.example (172.60.0.20) has left the cluster - there is now only 1 node in the cluster 2021.11.23 08:57:33 DEBUG [TaskEngine-pool-3]: org.jivesoftware.openfire.spi.RoutingTableImpl - Failed to route packet to JID: admin@xmpp.localhost.example packet: xmpp2.localhost.example (172.60.0.20) has left the cluster - there is now only 1 node in the cluster 2021.11.23 08:57:33 DEBUG [TaskEngine-pool-3]: org.jivesoftware.openfire.MessageRouter - Message sent to unreachable address: xmpp2.localhost.example (172.60.0.20) has left the cluster - there is now only 1 node in the cluster 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Looking for local (non-anonymous) client routes that have 'dropped out' of the cache (likely as a result of a network failure). 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Found no local (non-anonymous) user routes that are missing from the cache. 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Looking for local (non-anonymous) client routes that have 'dropped out' of the cache (likely as a result of a network failure). 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Found no local anonymous user routes that are missing from the cache. 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Cluster node a8a1a032-497f-461b-87b2-8af2f5dccde5 just left the cluster. A total of 0 outgoing server sessions was living there, and are no longer available. 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Removing node 'a8a1a032-497f-461b-87b2-8af2f5dccde5' from componentsByClusteredNode: [component.xmpp.localhost.example, proxy.xmpp.localhost.example, conference.xmpp.localhost.example, pubsub.xmpp.localhost.example] 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Cluster node a8a1a032-497f-461b-87b2-8af2f5dccde5 just left the cluster. A total of 0 component sessions is now no longer available as a result. 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Removing client route for user1@xmpp.localhost.example/Spark 2.9.4 that is no longer available because cluster node a8a1a032-497f-461b-87b2-8af2f5dccde5 left the cluster. 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Removed users cache entry for user1@xmpp.localhost.example/Spark 2.9.4 / ClientRoute{nodeID=a8a1a032-497f-461b-87b2-8af2f5dccde5, available=true}, changing entry count from 2 to 1 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Removing client route user1@xmpp.localhost.example/Spark 2.9.4 from local routing table 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Cluster node a8a1a032-497f-461b-87b2-8af2f5dccde5 just left the cluster. A total of 1 client routes was living there, and are no longer available. 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Restoring Users Sessions Cache 2021.11.23 08:57:33 DEBUG [NioProcessor-3]: org.apache.mina.filter.executor.OrderedThreadPoolExecutor - Adding event MESSAGE_SENT to session 2 Queue : [MESSAGE_SENT, ] 2021.11.23 08:57:33 DEBUG [socket_c2s-thread-2]: org.apache.mina.core.filterchain.IoFilterEvent - Firing a MESSAGE_SENT event for session 2 2021.11.23 08:57:33 DEBUG [socket_c2s-thread-2]: org.apache.mina.core.filterchain.IoFilterEvent - Event MESSAGE_SENT has been fired for session 2 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Failed to route packet to JID: user1@xmpp.localhost.example/Spark 2.9.4 packet: 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.PresenceRouter - Presence sent to unreachable address: 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.PresenceManagerImpl - Recording 'last activity' for user 'user1'. 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.SessionManager - Cluster node a8a1a032-497f-461b-87b2-8af2f5dccde5 just left the cluster. 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.SessionManager - Looking for local ClientSessionInfo instances that have 'dropped out' of the cache (likely as a result of a network failure). 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.SessionManager - Found no local ClientSessionInfo instances that are missing from the cache. 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.SessionManager - Looking for local component sessions that have 'dropped out' of the cache (likely as a result of a network failure). 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.SessionManager - Found no local component sessions that are missing from the cache. 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.SessionManager - Skip looking for local connection manager sessions that have 'dropped out' of the cache (likely as a result of a network failure), as these deprecated mechanisms aren't supported anymore. 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.SessionManager - Looking for local incoming server sessions that have 'dropped out' of the cache (likely as a result of a network failure). 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.SessionManager - Found no local incoming server sessions that are missing from the cache. 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.SessionManager - Looking for local domain sessions that have 'dropped out' of the cache (likely as a result of a network failure). 2021.11.23 08:57:33 INFO  [ClusterManager events dispatcher]: org.jivesoftware.openfire.SessionManager - Found no local domain sessions that are missing from the cache. 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Removed users cache entry for user1@xmpp.localhost.example/Spark 2.9.4 / null, changing entry count from 1 to 1 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Removing client route user1@xmpp.localhost.example/Spark 2.9.4 from local routing table 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.spi.RoutingTableImpl - Failed to route packet to JID: user1@xmpp.localhost.example/Spark 2.9.4 packet: 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.PresenceRouter - Presence sent to unreachable address: 2021.11.23 08:57:33 DEBUG [NioProcessor-3]: org.apache.mina.filter.executor.OrderedThreadPoolExecutor - Adding event MESSAGE_SENT to session 2 Queue : [MESSAGE_SENT, ] 2021.11.23 08:57:33 DEBUG [socket_c2s-thread-3]: org.apache.mina.core.filterchain.IoFilterEvent - Firing a MESSAGE_SENT event for session 2 2021.11.23 08:57:33 DEBUG [socket_c2s-thread-3]: org.apache.mina.core.filterchain.IoFilterEvent - Event MESSAGE_SENT has been fired for session 2 2021.11.23 08:57:33 DEBUG [ClusterManager events dispatcher]: org.jivesoftware.openfire.handler.PresenceUpdateHandler - Remove traces of directed presences sent from node 'a8a1a032-497f-461b-87b2-8af2f5dccde5' that is gone to entities hosted in this JVM. 2021.11.23 08:57:48 DEBUG [hz.openfire.cached.thread-1]: com.hazelcast.internal.partition.InternalPartitionService - [172.60.0.30]:5701 [openfire] [3.12.5] Checking partition state, version: 1898 2021.11.23 08:58:03 DEBUG [hz.openfire.cached.thread-2]: com.hazelcast.internal.partition.InternalPartitionService - [172.60.0.30]:5701 [openfire] [3.12.5] Checking partition state, version: 1898 2021.11.23 08:58:18 DEBUG [hz.openfire.cached.thread-2]: com.hazelcast.internal.partition.InternalPartitionService - [172.60.0.30]:5701 [openfire] [3.12.5] Checking partition state, version: 1898 2021.11.23 08:58:33 DEBUG [hz.openfire.cached.thread-3]: com.hazelcast.internal.partition.InternalPartitionService - [172.60.0.30]:5701 [openfire] [3.12.5] Checking partition state, version: 1898 2021.11.23 08:58:33 DEBUG [hz.openfire.MulticastThread]: com.hazelcast.internal.cluster.impl.NodeMulticastListener - [172.60.0.30]:5701 [openfire] [3.12.5] Dropped: SplitBrainJoinMessage{packetVersion=4, buildNumber=20191210, memberVersion=3.12.5, clusterVersion=3.12, address=[172.60.0.10]:5701, uuid='10956e89-fc85-4b93-bb24-039cb89a1a18', liteMember=false, memberCount=2, dataMemberCount=2, memberListVersion=4} 2021.11.23 08:58:33 DEBUG [hz.openfire.MulticastThread]: com.hazelcast.internal.cluster.impl.NodeMulticastListener - [172.60.0.30]:5701 [openfire] [3.12.5] Dropped: SplitBrainJoinMessage{packetVersion=4, buildNumber=20191210, memberVersion=3.12.5, clusterVersion=3.12, address=[172.60.0.30]:5701, uuid='98de1bb1-6448-4d12-b901-a5ecac93ba30', liteMember=false, memberCount=1, dataMemberCount=1, memberListVersion=4} 2021.11.23 08:58:33 DEBUG [hz.openfire.cached.thread-1]: com.hazelcast.internal.cluster.impl.MembershipManager - [172.60.0.30]:5701 [openfire] [3.12.5] Sending member list to the non-master nodes: Members {size:1, ver:4} [ Member [172.60.0.30]:5701 - 98de1bb1-6448-4d12-b901-a5ecac93ba30 this ] 2021.11.23 08:58:33 DEBUG [hz.openfire.cached.thread-2]: com.hazelcast.internal.cluster.impl.MulticastJoiner - [172.60.0.30]:5701 [openfire] [3.12.5] Received SplitBrainJoinMessage{packetVersion=4, buildNumber=20191210, memberVersion=3.12.5, clusterVersion=3.12, address=[172.60.0.10]:5701, uuid='10956e89-fc85-4b93-bb24-039cb89a1a18', liteMember=false, memberCount=2, dataMemberCount=2, memberListVersion=4} 2021.11.23 08:58:33 DEBUG [hz.openfire.cached.thread-2]: com.hazelcast.internal.cluster.impl.MulticastJoiner - [172.60.0.30]:5701 [openfire] [3.12.5] Sending SplitBrainJoinMessage to [172.60.0.10]:5701 2021.11.23 08:58:38 DEBUG [hz.openfire.cached.thread-2]: com.hazelcast.internal.cluster.impl.MulticastJoiner - [172.60.0.30]:5701 [openfire] [3.12.5] Returning null timeout<0, -10 2021.11.23 08:58:48 DEBUG [hz.openfire.cached.thread-6]: com.hazelcast.internal.partition.InternalPartitionService - [172.60.0.30]:5701 [openfire] [3.12.5] Checking partition state, version: 1898 2021.11.23 08:59:03 DEBUG [hz.openfire.cached.thread-2]: com.hazelcast.internal.partition.InternalPartitionService - [172.60.0.30]:5701 [openfire] [3.12.5] Checking partition state, version: 1898 2021.11.23 08:59:18 DEBUG [hz.openfire.cached.thread-10]: com.hazelcast.internal.partition.InternalPartitionService - [172.60.0.30]:5701 [openfire] [3.12.5] Checking partition state, version: 1898 2021.11.23 08:59:25 DEBUG [NioProcessor-3]: org.apache.mina.filter.executor.OrderedThreadPoolExecutor - Adding event SESSION_IDLE to session 2 Queue : [SESSION_IDLE, ] 2021.11.23 08:59:25 DEBUG [socket_c2s-thread-2]: org.apache.mina.core.filterchain.IoFilterEvent - Firing a SESSION_IDLE event for session 2 2021.11.23 08:59:25 DEBUG [socket_c2s-thread-2]: org.jivesoftware.openfire.nio.ClientConnectionHandler - ConnectionHandler: Pinging connection that has been idle: org.jivesoftware.openfire.nio.NIOConnection@5f81c9ea MINA Session: (0x00000002: nio socket, server, /172.60.0.1:36390 => /172.60.0.30:5222) 2021.11.23 08:59:25 DEBUG [socket_c2s-thread-2]: org.apache.mina.core.filterchain.IoFilterEvent - Event SESSION_IDLE has been fired for session 2 2021.11.23 08:59:25 DEBUG [NioProcessor-3]: org.apache.mina.filter.executor.OrderedThreadPoolExecutor - Adding event MESSAGE_SENT to session 2 Queue : [MESSAGE_SENT, ] 2021.11.23 08:59:25 DEBUG [socket_c2s-thread-3]: org.apache.mina.core.filterchain.IoFilterEvent - Firing a MESSAGE_SENT event for session 2 2021.11.23 08:59:25 DEBUG [socket_c2s-thread-3]: org.apache.mina.core.filterchain.IoFilterEvent - Event MESSAGE_SENT has been fired for session 2 2021.11.23 08:59:25 DEBUG [NioProcessor-3]: org.apache.mina.filter.executor.OrderedThreadPoolExecutor - Adding event MESSAGE_RECEIVED to session 2 Queue : [MESSAGE_RECEIVED, ] 2021.11.23 08:59:25 DEBUG [socket_c2s-thread-2]: org.apache.mina.core.filterchain.IoFilterEvent - Firing a MESSAGE_RECEIVED event for session 2 2021.11.23 08:59:25 DEBUG [socket_c2s-thread-2]: org.apache.mina.filter.codec.ProtocolCodecFilter - Processing a MESSAGE_RECEIVED for session 2 2021.11.23 08:59:25 DEBUG [socket_c2s-thread-2]: org.apache.mina.core.filterchain.IoFilterEvent - Event MESSAGE_RECEIVED has been fired for session 2 2021.11.23 08:59:33 DEBUG [hz.openfire.cached.thread-2]: com.hazelcast.internal.partition.InternalPartitionService - [172.60.0.30]:5701 [openfire] [3.12.5] Checking partition state, version: 1898 2021.11.23 08:59:33 DEBUG [hz.openfire.cached.thread-10]: com.hazelcast.internal.cluster.impl.MembershipManager - [172.60.0.30]:5701 [openfire] [3.12.5] Sending member list to the non-master nodes: Members {size:1, ver:4} [ Member [172.60.0.30]:5701 - 98de1bb1-6448-4d12-b901-a5ecac93ba30 this ] 2021.11.23 08:59:47 DEBUG [NioProcessor-3]: org.apache.mina.filter.executor.OrderedThreadPoolExecutor - Adding event MESSAGE_RECEIVED to session 2 Queue : [MESSAGE_RECEIVED, ] 2021.11.23 08:59:47 DEBUG [socket_c2s-thread-3]: org.apache.mina.core.filterchain.IoFilterEvent - Firing a MESSAGE_RECEIVED event for session 2 2021.11.23 08:59:47 DEBUG [NioProcessor-3]: org.apache.mina.filter.executor.OrderedThreadPoolExecutor - Adding event MESSAGE_RECEIVED to session 2 Queue : [MESSAGE_RECEIVED, ] 2021.11.23 08:59:47 DEBUG [socket_c2s-thread-3]: org.apache.mina.filter.codec.ProtocolCodecFilter - Processing a MESSAGE_RECEIVED for session 2 2021.11.23 08:59:47 DEBUG [socket_c2s-thread-3]: org.apache.mina.core.filterchain.IoFilterEvent - Event MESSAGE_RECEIVED has been fired for session 2 2021.11.23 08:59:47 DEBUG [socket_c2s-thread-3]: org.apache.mina.core.filterchain.IoFilterEvent - Firing a MESSAGE_RECEIVED event for session 2 2021.11.23 08:59:47 DEBUG [socket_c2s-thread-3]: org.apache.mina.filter.codec.ProtocolCodecFilter - Processing a MESSAGE_RECEIVED for session 2 2021.11.23 08:59:47 DEBUG [NioProcessor-3]: org.apache.mina.filter.executor.OrderedThreadPoolExecutor - Adding event MESSAGE_SENT to session 2 Queue : [MESSAGE_SENT, ] 2021.11.23 08:59:47 DEBUG [socket_c2s-thread-3]: org.apache.mina.core.filterchain.IoFilterEvent - Event MESSAGE_RECEIVED has been fired for session 2 2021.11.23 08:59:47 DEBUG [socket_c2s-thread-3]: org.apache.mina.core.filterchain.IoFilterEvent - Firing a MESSAGE_SENT event for session 2 2021.11.23 08:59:47 DEBUG [socket_c2s-thread-3]: org.apache.mina.core.filterchain.IoFilterEvent - Event MESSAGE_SENT has been fired for session 2 2021.11.23 08:59:48 DEBUG [hz.openfire.cached.thread-3]: com.hazelcast.internal.partition.InternalPartitionService - [172.60.0.30]:5701 [openfire] [3.12.5] Checking partition state, version: 1898 2021.11.23 09:00:03 DEBUG [hz.openfire.cached.thread-6]: com.hazelcast.internal.partition.InternalPartitionService - [172.60.0.30]:5701 [openfire] [3.12.5] Checking partition state, version: 1898 2021.11.23 09:00:18 DEBUG [hz.openfire.cached.thread-3]: com.hazelcast.internal.partition.InternalPartitionService - [172.60.0.30]:5701 [openfire] [3.12.5] Checking partition state, version: 1898 2021.11.23 09:00:33 DEBUG [hz.openfire.cached.thread-3]: com.hazelcast.internal.partition.InternalPartitionService - [172.60.0.30]:5701 [openfire] [3.12.5] Checking partition state, version: 1898 2021.11.23 09:00:33 DEBUG [hz.openfire.MulticastThread]: com.hazelcast.internal.cluster.impl.NodeMulticastListener - [172.60.0.30]:5701 [openfire] [3.12.5] Dropped: SplitBrainJoinMessage{packetVersion=4, buildNumber=20191210, memberVersion=3.12.5, clusterVersion=3.12, address=[172.60.0.10]:5701, uuid='10956e89-fc85-4b93-bb24-039cb89a1a18', liteMember=false, memberCount=2, dataMemberCount=2, memberListVersion=4} 2021.11.23 09:00:33 DEBUG [hz.openfire.cached.thread-1]: com.hazelcast.internal.cluster.impl.MulticastJoiner - [172.60.0.30]:5701 [openfire] [3.12.5] Received SplitBrainJoinMessage{packetVersion=4, buildNumber=20191210, memberVersion=3.12.5, clusterVersion=3.12, address=[172.60.0.10]:5701, uuid='10956e89-fc85-4b93-bb24-039cb89a1a18', liteMember=false, memberCount=2, dataMemberCount=2, memberListVersion=4} 2021.11.23 09:00:33 DEBUG [hz.openfire.MulticastThread]: com.hazelcast.internal.cluster.impl.NodeMulticastListener - [172.60.0.30]:5701 [openfire] [3.12.5] Dropped: SplitBrainJoinMessage{packetVersion=4, buildNumber=20191210, memberVersion=3.12.5, clusterVersion=3.12, address=[172.60.0.30]:5701, uuid='98de1bb1-6448-4d12-b901-a5ecac93ba30', liteMember=false, memberCount=1, dataMemberCount=1, memberListVersion=4} 2021.11.23 09:00:33 DEBUG [hz.openfire.cached.thread-1]: com.hazelcast.internal.cluster.impl.MulticastJoiner - [172.60.0.30]:5701 [openfire] [3.12.5] Sending SplitBrainJoinMessage to [172.60.0.10]:5701 2021.11.23 09:00:33 DEBUG [hz.openfire.cached.thread-2]: com.hazelcast.internal.cluster.impl.MembershipManager - [172.60.0.30]:5701 [openfire] [3.12.5] Sending member list to the non-master nodes: Members {size:1, ver:4} [ Member [172.60.0.30]:5701 - 98de1bb1-6448-4d12-b901-a5ecac93ba30 this ] 2021.11.23 09:00:35 DEBUG [NioProcessor-3]: org.apache.mina.filter.executor.OrderedThreadPoolExecutor - Adding event MESSAGE_RECEIVED to session 2 Queue : [MESSAGE_RECEIVED, ] 2021.11.23 09:00:35 DEBUG [socket_c2s-thread-3]: org.apache.mina.core.filterchain.IoFilterEvent - Firing a MESSAGE_RECEIVED event for session 2 2021.11.23 09:00:35 DEBUG [socket_c2s-thread-3]: org.apache.mina.filter.codec.ProtocolCodecFilter - Processing a MESSAGE_RECEIVED for session 2 2021.11.23 09:00:35 DEBUG [NioProcessor-3]: org.apache.mina.filter.executor.OrderedThreadPoolExecutor - Adding event MESSAGE_SENT to session 2 Queue : [MESSAGE_SENT, ] 2021.11.23 09:00:35 DEBUG [socket_c2s-thread-3]: org.apache.mina.core.filterchain.IoFilterEvent - Event MESSAGE_RECEIVED has been fired for session 2 2021.11.23 09:00:35 DEBUG [socket_c2s-thread-3]: org.apache.mina.core.filterchain.IoFilterEvent - Firing a MESSAGE_SENT event for session 2 2021.11.23 09:00:35 DEBUG [socket_c2s-thread-3]: org.apache.mina.core.filterchain.IoFilterEvent - Event MESSAGE_SENT has been fired for session 2 2021.11.23 09:00:37 DEBUG [NioProcessor-3]: org.apache.mina.filter.executor.OrderedThreadPoolExecutor - Adding event MESSAGE_RECEIVED to session 2 Queue : [MESSAGE_RECEIVED, ] 2021.11.23 09:00:37 DEBUG [socket_c2s-thread-2]: org.apache.mina.core.filterchain.IoFilterEvent - Firing a MESSAGE_RECEIVED event for session 2 2021.11.23 09:00:37 DEBUG [socket_c2s-thread-2]: org.apache.mina.filter.codec.ProtocolCodecFilter - Processing a MESSAGE_RECEIVED for session 2 2021.11.23 09:00:37 DEBUG [socket_c2s-thread-2]: org.apache.mina.core.filterchain.IoFilterEvent - Event MESSAGE_RECEIVED has been fired for session 2 2021.11.23 09:00:37 DEBUG [NioProcessor-3]: org.apache.mina.filter.executor.OrderedThreadPoolExecutor - Adding event MESSAGE_SENT to session 2 Queue : [MESSAGE_SENT, ] 2021.11.23 09:00:37 DEBUG [socket_c2s-thread-3]: org.apache.mina.core.filterchain.IoFilterEvent - Firing a MESSAGE_SENT event for session 2 2021.11.23 09:00:37 DEBUG [socket_c2s-thread-3]: org.apache.mina.core.filterchain.IoFilterEvent - Event MESSAGE_SENT has been fired for session 2 2021.11.23 09:00:37 DEBUG [NioProcessor-3]: org.apache.mina.filter.executor.OrderedThreadPoolExecutor - Adding event MESSAGE_RECEIVED to session 2 Queue : [MESSAGE_RECEIVED, ] 2021.11.23 09:00:37 DEBUG [socket_c2s-thread-2]: org.apache.mina.core.filterchain.IoFilterEvent - Firing a MESSAGE_RECEIVED event for session 2 2021.11.23 09:00:37 DEBUG [socket_c2s-thread-2]: org.apache.mina.filter.codec.ProtocolCodecFilter - Processing a MESSAGE_RECEIVED for session 2 2021.11.23 09:00:37 DEBUG [socket_c2s-thread-2]: org.apache.mina.core.filterchain.IoFilterEvent - Event MESSAGE_RECEIVED has been fired for session 2 2021.11.23 09:00:37 DEBUG [NioProcessor-3]: org.apache.mina.filter.executor.OrderedThreadPoolExecutor - Adding event MESSAGE_SENT to session 2 Queue : [MESSAGE_SENT, ] 2021.11.23 09:00:37 DEBUG [socket_c2s-thread-3]: org.apache.mina.core.filterchain.IoFilterEvent - Firing a MESSAGE_SENT event for session 2 2021.11.23 09:00:37 DEBUG [socket_c2s-thread-3]: org.apache.mina.core.filterchain.IoFilterEvent - Event MESSAGE_SENT has been fired for session 2 2021.11.23 09:00:37 DEBUG [NioProcessor-3]: org.apache.mina.filter.executor.OrderedThreadPoolExecutor - Adding event MESSAGE_RECEIVED to session 2 Queue : [MESSAGE_RECEIVED, ] 2021.11.23 09:00:37 DEBUG [socket_c2s-thread-2]: org.apache.mina.core.filterchain.IoFilterEvent - Firing a MESSAGE_RECEIVED event for session 2 2021.11.23 09:00:37 DEBUG [socket_c2s-thread-2]: org.apache.mina.filter.codec.ProtocolCodecFilter - Processing a MESSAGE_RECEIVED for session 2 2021.11.23 09:00:37 DEBUG [socket_c2s-thread-2]: org.apache.mina.core.filterchain.IoFilterEvent - Event MESSAGE_RECEIVED has been fired for session 2 2021.11.23 09:00:37 DEBUG [NioProcessor-3]: org.apache.mina.filter.executor.OrderedThreadPoolExecutor - Adding event MESSAGE_SENT to session 2 Queue : [MESSAGE_SENT, ] 2021.11.23 09:00:37 DEBUG [socket_c2s-thread-3]: org.apache.mina.core.filterchain.IoFilterEvent - Firing a MESSAGE_SENT event for session 2 2021.11.23 09:00:37 DEBUG [socket_c2s-thread-3]: org.apache.mina.core.filterchain.IoFilterEvent - Event MESSAGE_SENT has been fired for session 2 2021.11.23 09:00:37 DEBUG [NioProcessor-3]: org.apache.mina.filter.executor.OrderedThreadPoolExecutor - Adding event MESSAGE_RECEIVED to session 2 Queue : [MESSAGE_RECEIVED, ] 2021.11.23 09:00:37 DEBUG [socket_c2s-thread-2]: org.apache.mina.core.filterchain.IoFilterEvent - Firing a MESSAGE_RECEIVED event for session 2 2021.11.23 09:00:37 DEBUG [socket_c2s-thread-2]: org.apache.mina.filter.codec.ProtocolCodecFilter - Processing a MESSAGE_RECEIVED for session 2 2021.11.23 09:00:37 DEBUG [socket_c2s-thread-2]: org.apache.mina.core.filterchain.IoFilterEvent - Event MESSAGE_RECEIVED has been fired for session 2 2021.11.23 09:00:37 DEBUG [NioProcessor-3]: org.apache.mina.filter.executor.OrderedThreadPoolExecutor - Adding event MESSAGE_SENT to session 2 Queue : [MESSAGE_SENT, ] 2021.11.23 09:00:37 DEBUG [socket_c2s-thread-3]: org.apache.mina.core.filterchain.IoFilterEvent - Firing a MESSAGE_SENT event for session 2 2021.11.23 09:00:37 DEBUG [socket_c2s-thread-3]: org.apache.mina.core.filterchain.IoFilterEvent - Event MESSAGE_SENT has been fired for session 2 2021.11.23 09:00:38 DEBUG [hz.openfire.cached.thread-1]: com.hazelcast.internal.cluster.impl.MulticastJoiner - [172.60.0.30]:5701 [openfire] [3.12.5] Returning null timeout<0, -10 2021.11.23 09:00:41 DEBUG [Jetty-QTP-AdminConsole-128]: org.jivesoftware.openfire.muc.spi.MUCPersistenceManager - Loading room names for chat service conference 2021.11.23 09:00:41 DEBUG [Jetty-QTP-AdminConsole-128]: org.jivesoftware.openfire.muc.spi.MUCPersistenceManager - Loaded 2 room names for chat service conference 2021.11.23 09:00:41 DEBUG [Jetty-QTP-AdminConsole-128]: org.jivesoftware.openfire.muc.spi.MUCPersistenceManager - Attempting to load room 'muc2' from the database. 2021.11.23 09:00:41 DEBUG [Jetty-QTP-AdminConsole-128]: org.jivesoftware.openfire.group.GroupJID - Parsing JID from string: admin@xmpp.localhost.example 2021.11.23 09:00:41 DEBUG [Jetty-QTP-AdminConsole-128]: org.jivesoftware.openfire.muc.spi.FMUCHandler - (room: 'muc2@conference.xmpp.localhost.example'): Changing outbound join configuration. Existing: null, New: null 2021.11.23 09:00:43 DEBUG [NioProcessor-3]: org.apache.mina.filter.executor.OrderedThreadPoolExecutor - Adding event MESSAGE_RECEIVED to session 2 Queue : [MESSAGE_RECEIVED, ] 2021.11.23 09:00:43 DEBUG [socket_c2s-thread-2]: org.apache.mina.core.filterchain.IoFilterEvent - Firing a MESSAGE_RECEIVED event for session 2 2021.11.23 09:00:43 DEBUG [socket_c2s-thread-2]: org.apache.mina.filter.codec.ProtocolCodecFilter - Processing a MESSAGE_RECEIVED for session 2 2021.11.23 09:00:43 DEBUG [socket_c2s-thread-2]: org.apache.mina.core.filterchain.IoFilterEvent - Event MESSAGE_RECEIVED has been fired for session 2 2021.11.23 09:00:43 DEBUG [NioProcessor-3]: org.apache.mina.filter.executor.OrderedThreadPoolExecutor - Adding event MESSAGE_SENT to session 2 Queue : [MESSAGE_SENT, ]