2021-11-08T22:58:58.303096+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:58:58.302Z [WARN] agent.server.rpc: RPC request to DC is currently failing as no server can be reached: datacenter=clustereast2 2021-11-08T22:59:00.419476+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:00.419Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.18:8302: read tcp 10.242.89.235:46698->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:00.420815+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:00.419Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send indirect ping: read tcp 10.242.89.235:46692->10.242.89.235:19005: read: connection reset by peer from=10.242.88.195:8302 2021-11-08T22:59:00.918096+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:00.917Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.18:8302: read tcp 10.242.89.235:46712->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:05.213407+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:05.213Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.71:8302: read tcp 10.242.89.235:46718->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:05.216797+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:05.216Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send indirect ping: read tcp 10.242.89.235:46728->10.242.89.235:19005: read: connection reset by peer from=10.242.88.195:8302 2021-11-08T22:59:05.418215+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:05.417Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send indirect ping: read tcp 10.242.89.235:46734->10.242.89.235:19005: read: connection reset by peer from=10.242.90.214:8302 2021-11-08T22:59:05.418499+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:05.417Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.44:8302: read tcp 10.242.89.235:46738->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:09.751659+00:00 frame-consul10-242-89-235 consul[7165]: [2021-11-08 22:59:09.751][7165][info][upstream] [external/envoy/source/common/upstream/cds_api_impl.cc:77] cds: add 11 cluster(s), remove 1 cluster(s) 2021-11-08T22:59:09.753708+00:00 frame-consul10-242-89-235 consul[7165]: [2021-11-08 22:59:09.753][7165][info][upstream] [external/envoy/source/server/lds_api.cc:58] lds: remove listener 'wan_ipv4:10.242.89.235:19005' 2021-11-08T22:59:09.758229+00:00 frame-consul10-242-89-235 consul[7165]: [2021-11-08 22:59:09.757][7165][info][upstream] [external/envoy/source/server/lds_api.cc:76] lds: add/update listener 'wan:10.242.89.235:19005' 2021-11-08T22:59:15.418980+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:15.418Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send compound ping and suspect message to 10.253.176.44:8302: read tcp 10.242.89.235:46760->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:15.419288+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:15.418Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.44:8302: read tcp 10.242.89.235:46750->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:15.705086+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:15.704Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.44:8302: read tcp 10.242.89.235:46766->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:17.418256+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:17.417Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.44:8302: read tcp 10.242.89.235:46780->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:19.320682+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:19.320Z [WARN] agent.server.rpc: RPC request to DC is currently failing as no server can be reached: datacenter=clustereast2 2021-11-08T22:59:20.419486+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:20.419Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.44:8302: read tcp 10.242.89.235:46786->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:20.420593+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:20.419Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.18:8302: read tcp 10.242.89.235:46802->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:20.421070+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:20.420Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send indirect ping: read tcp 10.242.89.235:46806->10.242.89.235:19005: read: connection reset by peer from=10.242.88.195:8302 2021-11-08T22:59:21.418242+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:21.417Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.18:8302: read tcp 10.242.89.235:46820->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:22.417809+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:22.417Z [INFO] agent.server.memberlist.wan: memberlist: Suspect azureeast2-server-0.clustereast2 has failed, no acks received 2021-11-08T22:59:22.427747+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:22.426Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.71:8302: read tcp 10.242.89.235:46828->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:22.705137+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:22.704Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.71:8302: read tcp 10.242.89.235:46834->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:22.795744+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:22.795Z [INFO] agent.server.memberlist.wan: memberlist: Marking azureeast2-server-1.clustereast2 as failed, suspect timeout reached (4 peer confirmations) 2021-11-08T22:59:22.795987+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:22.795Z [INFO] agent.server.serf.wan: serf: EventMemberFailed: azureeast2-server-1.clustereast2 10.253.176.71 2021-11-08T22:59:22.796152+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:22.795Z [INFO] agent.server: Handled event for server in area: event=member-failed server=azureeast2-server-1.clustereast2 area=wan 2021-11-08T22:59:23.297845+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:23.297Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.18:8302: read tcp 10.242.89.235:46844->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:24.935209+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:24.934Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.44:8302: read tcp 10.242.89.235:46848->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:24.936653+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:24.936Z [INFO] agent.server.serf.wan: serf: EventMemberJoin: azureeast2-server-1.clustereast2 10.253.176.71 2021-11-08T22:59:24.936882+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:24.936Z [INFO] agent.server: Handled event for server in area: event=member-join server=azureeast2-server-1.clustereast2 area=wan 2021-11-08T22:59:25.420336+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:25.419Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.71:8302: read tcp 10.242.89.235:46856->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:25.420509+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:25.419Z [ERROR] agent.server.rpc: RPC failed to server in DC: server=10.253.176.18:8300 datacenter=clustereast2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: read tcp 10.242.89.235:46862->10.242.89.235:19005: read: connection reset by peer" 2021-11-08T22:59:25.421123+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:25.420Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.18:8302: read tcp 10.242.89.235:46870->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:25.421313+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:25.420Z [ERROR] agent.server.rpc: RPC failed to server in DC: server=10.253.176.44:8300 datacenter=clustereast2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: read tcp 10.242.89.235:46872->10.242.89.235:19005: read: connection reset by peer" 2021-11-08T22:59:26.418586+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:26.418Z [ERROR] agent.server.rpc: RPC failed to server in DC: server=10.253.176.71:8300 datacenter=clustereast2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: read tcp 10.242.89.235:46878->10.242.89.235:19005: read: connection reset by peer" 2021-11-08T22:59:26.418828+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:26.418Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.18:8302: read tcp 10.242.89.235:46886->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:27.710317+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:27.709Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.44:8302: read tcp 10.242.89.235:46898->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:27.710577+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:27.710Z [ERROR] agent.server.rpc: RPC failed to server in DC: server=10.253.176.18:8300 datacenter=clustereast2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: read tcp 10.242.89.235:46896->10.242.89.235:19005: read: connection reset by peer" 2021-11-08T22:59:27.918262+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:27.917Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.71:8302: read tcp 10.242.89.235:46906->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:28.418204+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:28.417Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.44:8302: read tcp 10.242.89.235:46914->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:30.421483+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:30.421Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send indirect ping: read tcp 10.242.89.235:46924->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:30.918868+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:30.918Z [ERROR] agent.server.rpc: RPC failed to server in DC: server=10.253.176.44:8300 datacenter=clustereast2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: read tcp 10.242.89.235:46934->10.242.89.235:19005: read: connection reset by peer" 2021-11-08T22:59:30.919133+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:30.918Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send indirect ping: read tcp 10.242.89.235:46928->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:32.711465+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:32.711Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send ping: read tcp 10.242.89.235:46944->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:32.918306+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:32.917Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.18:8302: read tcp 10.242.89.235:46960->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:32.918565+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:32.918Z [ERROR] agent.server.rpc: RPC failed to server in DC: server=10.253.176.71:8300 datacenter=clustereast2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: read tcp 10.242.89.235:46948->10.242.89.235:19005: read: connection reset by peer" 2021-11-08T22:59:32.918740+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:32.918Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send indirect ping: read tcp 10.242.89.235:46954->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:35.418269+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:35.417Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.18:8302: read tcp 10.242.89.235:46972->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:35.421918+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:35.421Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.44:8302: read tcp 10.242.89.235:46976->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:35.422147+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:35.421Z [ERROR] agent.server.rpc: RPC failed to server in DC: server=10.253.176.18:8300 datacenter=clustereast2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: read tcp 10.242.89.235:46968->10.242.89.235:19005: read: connection reset by peer" 2021-11-08T22:59:35.935115+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:35.934Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.18:8302: read tcp 10.242.89.235:46980->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:49.258449+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:49.258Z [ERROR] agent.server.rpc: RPC failed to server in DC: server=10.253.176.44:8300 datacenter=clustereast2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: read tcp 10.242.89.235:46996->10.242.89.235:19005: read: connection reset by peer" 2021-11-08T22:59:52.417896+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:52.417Z [INFO] agent.server.memberlist.wan: memberlist: Suspect azureeast2-server-1.clustereast2 has failed, no acks received 2021-11-08T22:59:54.704658+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:54.704Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.71:8302: read tcp 10.242.89.235:47014->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:57.919291+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:57.918Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send ping: read tcp 10.242.89.235:47032->10.242.89.235:19005: read: connection reset by peer 2021-11-08T22:59:57.919530+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:57.918Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send indirect ping: read tcp 10.242.89.235:47024->10.242.89.235:19005: read: connection reset by peer from=10.242.90.214:8302 2021-11-08T22:59:59.936289+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T22:59:59.936Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.44:8302: read tcp 10.242.89.235:47048->10.242.89.235:19005: read: connection reset by peer 2021-11-08T23:00:02.418957+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:02.418Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.44:8302: read tcp 10.242.89.235:47068->10.242.89.235:19005: read: connection reset by peer 2021-11-08T23:00:02.419453+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:02.419Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send nack: read tcp 10.242.89.235:47064->10.242.89.235:19005: read: connection reset by peer from=10.253.176.71:8302 2021-11-08T23:00:02.706095+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:02.705Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.18:8302: read tcp 10.242.89.235:47072->10.242.89.235:19005: read: connection reset by peer 2021-11-08T23:00:04.937479+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:04.937Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.44:8302: read tcp 10.242.89.235:47078->10.242.89.235:19005: read: connection reset by peer 2021-11-08T23:00:05.919119+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:05.918Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send indirect ping: read tcp 10.242.89.235:47094->10.242.89.235:19005: read: connection reset by peer from=10.242.88.195:8302 2021-11-08T23:00:17.031047+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:17.030Z [ERROR] agent.server.rpc: RPC failed to server in DC: server=10.253.176.71:8300 datacenter=clustereast2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: read tcp 10.242.89.235:47110->10.242.89.235:19005: read: connection reset by peer" 2021-11-08T23:00:17.417751+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:17.417Z [INFO] agent.server.memberlist.wan: memberlist: Suspect azureeast2-server-2.clustereast2 has failed, no acks received 2021-11-08T23:00:18.564134+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:18.563Z [ERROR] agent.server.rpc: RPC failed to server in DC: server=10.253.176.18:8300 datacenter=clustereast2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: read tcp 10.242.89.235:47128->10.242.89.235:19005: read: connection reset by peer" 2021-11-08T23:00:22.708197+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:22.707Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.18:8302: read tcp 10.242.89.235:47146->10.242.89.235:19005: read: connection reset by peer 2021-11-08T23:00:23.565524+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:23.565Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.18:8302: read tcp 10.242.89.235:47156->10.242.89.235:19005: read: connection reset by peer 2021-11-08T23:00:24.705751+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:24.705Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.18:8302: read tcp 10.242.89.235:47166->10.242.89.235:19005: read: connection reset by peer 2021-11-08T23:00:27.015086+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:27.014Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.44:8302: read tcp 10.242.89.235:47178->10.242.89.235:19005: read: connection reset by peer 2021-11-08T23:00:27.418108+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:27.417Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.71:8302: read tcp 10.242.89.235:47182->10.242.89.235:19005: read: connection reset by peer 2021-11-08T23:00:35.418348+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:35.418Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.71:8302: read tcp 10.242.89.235:47214->10.242.89.235:19005: read: connection reset by peer 2021-11-08T23:00:35.418685+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:35.418Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send indirect ping: read tcp 10.242.89.235:47200->10.242.89.235:19005: read: connection reset by peer 2021-11-08T23:00:35.936067+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:35.935Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.71:8302: read tcp 10.242.89.235:47232->10.242.89.235:19005: read: connection reset by peer 2021-11-08T23:00:37.205310+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:37.204Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.71:8302: read tcp 10.242.89.235:47240->10.242.89.235:19005: read: connection reset by peer 2021-11-08T23:00:37.418859+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:37.417Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send compound ping and suspect message to 10.253.176.44:8302: read tcp 10.242.89.235:47244->10.242.89.235:19005: read: connection reset by peer 2021-11-08T23:00:37.936525+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:37.936Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send indirect ping: read tcp 10.242.89.235:47248->10.242.89.235:19005: read: connection reset by peer 2021-11-08T23:00:40.419156+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:40.418Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.44:8302: read tcp 10.242.89.235:47266->10.242.89.235:19005: read: connection reset by peer 2021-11-08T23:00:40.937413+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:40.937Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.44:8302: read tcp 10.242.89.235:47270->10.242.89.235:19005: read: connection reset by peer 2021-11-08T23:00:42.417791+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:42.417Z [INFO] agent.server.memberlist.wan: memberlist: Suspect azureeast2-server-0.clustereast2 has failed, no acks received 2021-11-08T23:00:42.419443+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:42.418Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.44:8302: read tcp 10.242.89.235:47276->10.242.89.235:19005: read: connection reset by peer 2021-11-08T23:00:42.938299+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:42.937Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.44:8302: read tcp 10.242.89.235:47292->10.242.89.235:19005: read: connection reset by peer 2021-11-08T23:00:43.418839+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:43.418Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.71:8302: read tcp 10.242.89.235:47298->10.242.89.235:19005: read: connection reset by peer 2021-11-08T23:00:45.419459+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:45.419Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.44:8302: read tcp 10.242.89.235:47304->10.242.89.235:19005: read: connection reset by peer 2021-11-08T23:00:46.449690+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:46.449Z [ERROR] agent.server.rpc: RPC failed to server in DC: server=10.253.176.44:8300 datacenter=clustereast2 method=Internal.ServiceDump error="rpc error getting client: failed to get conn: read tcp 10.242.89.235:47314->10.242.89.235:19005: read: connection reset by peer" 2021-11-08T23:00:47.939070+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:47.938Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.18:8302: read tcp 10.242.89.235:47332->10.242.89.235:19005: read: connection reset by peer 2021-11-08T23:00:48.058145+00:00 frame-consul10-242-89-235 systemd[1]: Stopping "HashiCorp Consul - Connect Sidecar Proxy"... 2021-11-08T23:00:48.058759+00:00 frame-consul10-242-89-235 consul[7165]: [2021-11-08 23:00:48.057][7165][warning][main] [external/envoy/source/server/server.cc:493] caught SIGTERM 2021-11-08T23:00:48.059051+00:00 frame-consul10-242-89-235 consul[7165]: [2021-11-08 23:00:48.057][7165][info][main] [external/envoy/source/server/server.cc:613] shutting down server instance 2021-11-08T23:00:48.059254+00:00 frame-consul10-242-89-235 consul[7165]: [2021-11-08 23:00:48.057][7165][info][main] [external/envoy/source/server/server.cc:560] main dispatch loop exited 2021-11-08T23:00:48.086286+00:00 frame-consul10-242-89-235 systemd[1]: Stopping "HashiCorp Consul - A service mesh solution"... 2021-11-08T23:00:48.086522+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:48.085Z [INFO] agent: Caught: signal=terminated 2021-11-08T23:00:48.086746+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:48.085Z [INFO] agent: Graceful shutdown disabled. Exiting 2021-11-08T23:00:48.086943+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:48.085Z [INFO] agent: Requesting shutdown 2021-11-08T23:00:48.087129+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:48.085Z [INFO] agent.server: shutting down server 2021-11-08T23:00:48.087283+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:48.085Z [WARN] agent.server.serf.lan: serf: Shutdown without a Leave 2021-11-08T23:00:48.087429+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:48.086Z [INFO] agent.server: shutting down Connect CA roots monitor 2021-11-08T23:00:48.089912+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:48.088Z [WARN] agent.server.serf.wan: serf: Shutdown without a Leave 2021-11-08T23:00:48.090113+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:48.088Z [INFO] agent.server.router.manager: shutting down 2021-11-08T23:00:48.090279+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:48.088Z [INFO] agent.server.router.manager: shutting down 2021-11-08T23:00:48.090428+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:48.088Z [INFO] agent.server.router.manager: shutting down 2021-11-08T23:00:48.090578+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:48.088Z [INFO] agent.server.router.manager: shutting down 2021-11-08T23:00:48.090744+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:48.088Z [INFO] agent: consul server down 2021-11-08T23:00:48.090891+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:48.088Z [INFO] agent: shutdown complete 2021-11-08T23:00:48.091034+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:48.088Z [INFO] agent: Stopping server: protocol=DNS address=0.0.0.0:8600 network=tcp 2021-11-08T23:00:48.091178+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:48.088Z [INFO] agent: Stopping server: protocol=DNS address=0.0.0.0:8600 network=udp 2021-11-08T23:00:48.091311+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:48.089Z [INFO] agent: Stopping server: protocol=HTTP address=[::]:8500 network=tcp 2021-11-08T23:00:48.091444+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:48.089Z [INFO] agent: Stopping server: protocol=HTTPS address=[::]:8501 network=tcp 2021-11-08T23:00:48.091579+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:48.089Z [INFO] agent: Waiting for endpoints to shut down 2021-11-08T23:00:48.091731+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:48.089Z [INFO] agent: Endpoints down 2021-11-08T23:00:48.091892+00:00 frame-consul10-242-89-235 consul[7148]: 2021-11-08T23:00:48.089Z [INFO] agent: Exit code: code=1 2021-11-08T23:00:48.094933+00:00 frame-consul10-242-89-235 systemd[1]: consul.service: main process exited, code=exited, status=1/FAILURE 2021-11-08T23:00:48.095138+00:00 frame-consul10-242-89-235 systemd[1]: Unit consul.service entered failed state. 2021-11-08T23:00:48.095308+00:00 frame-consul10-242-89-235 systemd[1]: consul.service failed. 2021-11-08T23:00:48.098267+00:00 frame-consul10-242-89-235 systemd[1]: Started "HashiCorp Consul - A service mesh solution". 2021-11-08T23:00:48.098704+00:00 frame-consul10-242-89-235 systemd[1]: Starting "HashiCorp Consul - A service mesh solution"... 2021-11-08T23:00:48.098895+00:00 frame-consul10-242-89-235 systemd[1]: Started "HashiCorp Consul - Connect Sidecar Proxy". 2021-11-08T23:00:48.099067+00:00 frame-consul10-242-89-235 systemd[1]: Starting "HashiCorp Consul - Connect Sidecar Proxy"... 2021-11-08T23:00:48.185214+00:00 frame-consul10-242-89-235 consul[7765]: ==> Error registering service "mesh-gateway-primary": Put "http://127.0.0.1:8500/v1/agent/service/register": dial tcp 127.0.0.1:8500: connect: connection refused 2021-11-08T23:00:48.187427+00:00 frame-consul10-242-89-235 systemd[1]: consul-connect-mesh-gateway.service: main process exited, code=exited, status=1/FAILURE 2021-11-08T23:00:48.187656+00:00 frame-consul10-242-89-235 systemd[1]: Unit consul-connect-mesh-gateway.service entered failed state. 2021-11-08T23:00:48.187862+00:00 frame-consul10-242-89-235 systemd[1]: consul-connect-mesh-gateway.service failed. 2021-11-08T23:00:48.196613+00:00 frame-consul10-242-89-235 consul[7764]: skipping file /etc/consul.d/agent.hcl_backup, extension must be .hcl or .json, or config format must be set 2021-11-08T23:00:48.196885+00:00 frame-consul10-242-89-235 consul[7764]: skipping file /etc/consul.d/server.hcl_backup, extension must be .hcl or .json, or config format must be set 2021-11-08T23:00:48.197065+00:00 frame-consul10-242-89-235 consul[7764]: bootstrap_expect > 0: expecting 3 servers 2021-11-08T23:00:48.205354+00:00 frame-consul10-242-89-235 consul[7764]: ==> Starting Consul agent... 2021-11-08T23:00:48.205568+00:00 frame-consul10-242-89-235 consul[7764]: Version: '1.8.3' 2021-11-08T23:00:48.205781+00:00 frame-consul10-242-89-235 consul[7764]: Node ID: '1e1cd66a-5b27-1b3c-1b01-0956bc2e9110' 2021-11-08T23:00:48.205967+00:00 frame-consul10-242-89-235 consul[7764]: Node name: 'frame-consul10-242-89-235' 2021-11-08T23:00:48.206177+00:00 frame-consul10-242-89-235 consul[7764]: Datacenter: 'frame' (Segment: '') 2021-11-08T23:00:48.206358+00:00 frame-consul10-242-89-235 consul[7764]: Server: true (Bootstrap: false) 2021-11-08T23:00:48.206537+00:00 frame-consul10-242-89-235 consul[7764]: Client Addr: [0.0.0.0] (HTTP: 8500, HTTPS: 8501, gRPC: 8502, DNS: 8600) 2021-11-08T23:00:48.206731+00:00 frame-consul10-242-89-235 consul[7764]: Cluster Addr: 10.242.89.235 (LAN: 8301, WAN: 8302) 2021-11-08T23:00:48.206912+00:00 frame-consul10-242-89-235 consul[7764]: Encrypt: Gossip: true, TLS-Outgoing: true, TLS-Incoming: false, Auto-Encrypt-TLS: true 2021-11-08T23:00:48.207087+00:00 frame-consul10-242-89-235 consul[7764]: ==> Log data will now stream in as it occurs: 2021-11-08T23:00:48.214900+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.211Z [WARN] agent.auto_config: skipping file /etc/consul.d/agent.hcl_backup, extension must be .hcl or .json, or config format must be set 2021-11-08T23:00:48.215118+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.211Z [WARN] agent.auto_config: skipping file /etc/consul.d/server.hcl_backup, extension must be .hcl or .json, or config format must be set 2021-11-08T23:00:48.215311+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.211Z [WARN] agent.auto_config: bootstrap_expect > 0: expecting 3 servers 2021-11-08T23:00:48.228306+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.228Z [INFO] agent.server.raft: restored from snapshot: id=607-1067359-1636409088155 2021-11-08T23:00:48.234599+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.234Z [INFO] agent.server.raft: initial configuration: index=979935 servers="[{Suffrage:Voter ID:fa8f6e65-cb6a-c955-f939-f8395dee5315 Address:10.242.88.195:8300} {Suffrage:Voter ID:1e1cd66a-5b27-1b3c-1b01-0956bc2e9110 Address:10.242.89.235:8300} {Suffrage:Voter ID:27a61e33-a252-49ca-a5a8-cc9d403fb95d Address:10.242.90.214:8300}]" 2021-11-08T23:00:48.236001+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.235Z [INFO] agent.server.raft: entering follower state: follower="Node at 10.242.89.235:8300 [Follower]" leader= 2021-11-08T23:00:48.236249+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.235Z [INFO] agent.server.serf.wan: serf: EventMemberJoin: frame-consul10-242-89-235.frame 10.242.89.235 2021-11-08T23:00:48.236451+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.235Z [INFO] agent.server.serf.wan: serf: Attempting re-join to previously known node: azureeast2-server-1.clustereast2: 10.253.176.71:8302 2021-11-08T23:00:48.236864+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.235Z [INFO] agent.server.serf.wan: serf: Attempting re-join to previously known node: frame-consul10-242-90-214.frame: 10.242.90.214:8302 2021-11-08T23:00:48.237077+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.236Z [INFO] agent.server.serf.lan: serf: EventMemberJoin: frame-consul10-242-89-235 10.242.89.235 2021-11-08T23:00:48.237684+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.237Z [INFO] agent: Started DNS server: address=0.0.0.0:8600 network=udp 2021-11-08T23:00:48.237894+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.237Z [INFO] agent.server.serf.lan: serf: Attempting re-join to previously known node: frame-gateway-external-api10-242-89-86: 10.242.89.86:8301 2021-11-08T23:00:48.238097+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.237Z [INFO] agent.server: Adding LAN server: server="frame-consul10-242-89-235 (Addr: tcp/10.242.89.235:8300) (DC: frame)" 2021-11-08T23:00:48.238295+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.237Z [INFO] agent.server: Raft data found, disabling bootstrap mode 2021-11-08T23:00:48.238481+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.237Z [INFO] agent.server: Handled event for server in area: event=member-join server=frame-consul10-242-89-235.frame area=wan 2021-11-08T23:00:48.238694+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.237Z [INFO] agent: Started DNS server: address=0.0.0.0:8600 network=tcp 2021-11-08T23:00:48.239878+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.238Z [INFO] agent: Started HTTP server: address=[::]:8500 network=tcp 2021-11-08T23:00:48.240070+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.238Z [INFO] agent: Started HTTPS server: address=[::]:8501 network=tcp 2021-11-08T23:00:48.240250+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.238Z [INFO] agent: started state syncer 2021-11-08T23:00:48.240414+00:00 frame-consul10-242-89-235 consul[7764]: ==> Consul agent running! 2021-11-08T23:00:48.240573+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.239Z [INFO] agent: Retry join is supported for the following discovery methods: cluster=LAN discovery_methods="aliyun aws azure digitalocean gce k8s linode mdns os packet scaleway softlayer tencentcloud triton vsphere" 2021-11-08T23:00:48.240752+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.239Z [INFO] agent: Joining cluster...: cluster=LAN 2021-11-08T23:00:48.240916+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.239Z [INFO] agent: discover-aws: Address type is not supported. Valid values are {private_v4,public_v4,public_v6}. Falling back to 'private_v4': cluster=LAN 2021-11-08T23:00:48.241071+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.239Z [INFO] agent: discover-aws: Region not provided. Looking up region in metadata...: cluster=LAN 2021-11-08T23:00:48.241239+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.239Z [INFO] agent: Started gRPC server: address=[::]:8502 network=tcp 2021-11-08T23:00:48.241913+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.241Z [INFO] agent.server.serf.wan: serf: EventMemberJoin: frame-consul10-242-88-195.frame 10.242.88.195 2021-11-08T23:00:48.243160+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.242Z [INFO] agent.server.serf.wan: serf: EventMemberJoin: frame-consul10-242-90-214.frame 10.242.90.214 2021-11-08T23:00:48.243349+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.242Z [INFO] agent.server.serf.wan: serf: EventMemberJoin: azureeast2-server-1.clustereast2 10.253.176.71 2021-11-08T23:00:48.243548+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.242Z [WARN] agent.server.memberlist.wan: memberlist: Refuting an alive message for 'frame-consul10-242-89-235.frame' (10.242.89.235:8302) meta:([255 142 163 118 115 110 161 50 167 118 115 110 95 109 97 120 161 51 165 98 117 105 108 100 174 49 46 56 46 51 58 97 57 51 50 50 98 57 99 165 102 116 95 102 115 161 49 167 117 115 101 95 116 108 115 161 49 168 114 97 102 116 95 118 115 110 161 51 166 101 120 112 101 99 116 161 51 167 115 101 103 109 101 110 116 160 167 118 115 110 95 109 105 110 161 50 164 97 99 108 115 161 49 162 105 100 218 0 36 49 101 49 99 100 54 54 97 45 53 98 50 55 45 49 98 51 99 45 49 98 48 49 45 48 57 53 54 98 99 50 101 57 49 49 48 164 112 111 114 116 164 56 51 48 48 162 100 99 165 102 114 97 109 101 164 114 111 108 101 166 99 111 110 115 117 108] VS [255 142 168 114 97 102 116 95 118 115 110 161 51 167 117 115 101 95 116 108 115 161 49 167 115 101 103 109 101 110 116 160 163 118 115 110 161 50 164 97 99 108 115 161 50 162 100 99 165 102 114 97 109 101 164 112 111 114 116 164 56 51 48 48 165 98 117 105 108 100 174 49 46 56 46 51 58 97 57 51 50 50 98 57 99 166 101 120 112 101 99 116 161 51 164 114 111 108 101 166 99 111 110 115 117 108 167 118 115 110 95 109 97 120 161 51 165 102 116 95 102 115 161 49 162 105 100 218 0 36 49 101 49 99 100 54 54 97 45 53 98 50 55 45 49 98 51 99 45 49 98 48 49 45 48 57 53 54 98 99 50 101 57 49 49 48 167 118 115 110 95 109 105 110 161 50]), vsn:([1 5 2 2 5 4] VS [1 5 2 2 5 4]) 2021-11-08T23:00:48.244757+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.242Z [INFO] agent.server.serf.wan: serf: EventMemberJoin: azureeast2-server-2.clustereast2 10.253.176.18 2021-11-08T23:00:48.244954+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.242Z [INFO] agent.server.serf.wan: serf: Re-joined to previously known node: frame-consul10-242-90-214.frame: 10.242.90.214:8302 2021-11-08T23:00:48.245148+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.242Z [INFO] agent.server: Handled event for server in area: event=member-join server=frame-consul10-242-88-195.frame area=wan 2021-11-08T23:00:48.246295+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.242Z [INFO] agent.server: Handled event for server in area: event=member-join server=frame-consul10-242-90-214.frame area=wan 2021-11-08T23:00:48.246488+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.242Z [INFO] agent.server: Handled event for server in area: event=member-join server=azureeast2-server-1.clustereast2 area=wan 2021-11-08T23:00:48.246897+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.242Z [INFO] agent.server: Handled event for server in area: event=member-join server=azureeast2-server-2.clustereast2 area=wan 2021-11-08T23:00:48.247105+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.244Z [INFO] agent: discover-aws: Region is us-east-1: cluster=LAN 2021-11-08T23:00:48.247294+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.244Z [INFO] agent: discover-aws: Filter instances with consul_auto_join=sysazure: cluster=LAN 2021-11-08T23:00:48.470996+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.470Z [INFO] agent: discover-aws: Instance i-0a5f9950b8212d51b has private ip 10.242.89.235: cluster=LAN 2021-11-08T23:00:48.471277+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.470Z [INFO] agent: discover-aws: Instance i-03946e29aa07b3eec has private ip 10.242.90.214: cluster=LAN 2021-11-08T23:00:48.471481+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.470Z [INFO] agent: discover-aws: Instance i-0e06beefce7c287ad has private ip 10.242.88.195: cluster=LAN 2021-11-08T23:00:48.471713+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.470Z [INFO] agent: Discovered servers: cluster=LAN cluster=LAN servers="10.242.89.235 10.242.90.214 10.242.88.195" 2021-11-08T23:00:48.471901+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.470Z [INFO] agent: (LAN) joining: lan_addresses=[10.242.89.235, 10.242.90.214, 10.242.88.195] 2021-11-08T23:00:48.473373+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.473Z [INFO] agent.server.serf.lan: serf: EventMemberJoin: frame-consul10-242-90-214 10.242.90.214 2021-11-08T23:00:48.473615+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.473Z [INFO] agent.server.serf.lan: serf: EventMemberJoin: frame-consul10-242-88-195 10.242.88.195 2021-11-08T23:00:48.474108+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.473Z [WARN] agent.server.memberlist.lan: memberlist: Refuting an alive message for 'frame-consul10-242-89-235' (10.242.89.235:8301) meta:([255 143 162 105 100 218 0 36 49 101 49 99 100 54 54 97 45 53 98 50 55 45 49 98 51 99 45 49 98 48 49 45 48 57 53 54 98 99 50 101 57 49 49 48 163 118 115 110 161 50 164 114 111 108 101 166 99 111 110 115 117 108 167 117 115 101 95 116 108 115 161 49 167 115 101 103 109 101 110 116 160 166 101 120 112 101 99 116 161 51 164 112 111 114 116 164 56 51 48 48 173 119 97 110 95 106 111 105 110 95 112 111 114 116 164 56 51 48 50 165 102 116 95 102 115 161 49 164 97 99 108 115 161 49 162 100 99 165 102 114 97 109 101 165 98 117 105 108 100 174 49 46 56 46 51 58 97 57 51 50 50 98 57 99 167 118 115 110 95 109 105 110 161 50 168 114 97 102 116 95 118 115 110 161 51 167 118 115 110 95 109 97 120 161 51] VS [255 143 162 100 99 165 102 114 97 109 101 167 118 115 110 95 109 97 120 161 51 167 117 115 101 95 116 108 115 161 49 164 112 111 114 116 164 56 51 48 48 165 102 116 95 102 115 161 49 167 115 101 103 109 101 110 116 160 162 105 100 218 0 36 49 101 49 99 100 54 54 97 45 53 98 50 55 45 49 98 51 99 45 49 98 48 49 45 48 57 53 54 98 99 50 101 57 49 49 48 163 118 115 110 161 50 168 114 97 102 116 95 118 115 110 161 51 166 101 120 112 101 99 116 161 51 164 97 99 108 115 161 50 173 119 97 110 95 106 111 105 110 95 112 111 114 116 164 56 51 48 50 164 114 111 108 101 166 99 111 110 115 117 108 167 118 115 110 95 109 105 110 161 50 165 98 117 105 108 100 174 49 46 56 46 51 58 97 57 51 50 50 98 57 99]), vsn:([1 5 2 2 5 4] VS [1 5 2 2 5 4]) 2021-11-08T23:00:48.475223+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.473Z [INFO] agent.server: Adding LAN server: server="frame-consul10-242-90-214 (Addr: tcp/10.242.90.214:8300) (DC: frame)" 2021-11-08T23:00:48.475425+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.473Z [INFO] agent.server: Adding LAN server: server="frame-consul10-242-88-195 (Addr: tcp/10.242.88.195:8300) (DC: frame)" 2021-11-08T23:00:48.476261+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.475Z [INFO] agent: (LAN) joined: number_of_nodes=3 2021-11-08T23:00:48.476440+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.475Z [INFO] agent: Join cluster completed. Synced with initial agents: cluster=LAN num_agents=3 2021-11-08T23:00:48.501216+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.501Z [INFO] agent: Synced node info 2021-11-08T23:00:48.507460+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.507Z [INFO] agent: Synced check: check=service:mesh-gateway-primary 2021-11-08T23:00:48.590016+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.589Z [INFO] agent.server.serf.lan: serf: EventMemberUpdate: frame-consul10-242-89-235 2021-11-08T23:00:48.590247+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.589Z [INFO] agent.server: Updating LAN server: server="frame-consul10-242-89-235 (Addr: tcp/10.242.89.235:8300) (DC: frame)" 2021-11-08T23:00:48.736244+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.735Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.71:8302: Remote DC has no server currently reachable 2021-11-08T23:00:48.836985+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.836Z [INFO] agent.server.serf.wan: serf: EventMemberUpdate: frame-consul10-242-89-235.frame 2021-11-08T23:00:48.837211+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:48.836Z [INFO] agent.server: Handled event for server in area: event=member-update server=frame-consul10-242-89-235.frame area=wan 2021-11-08T23:00:49.621570+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:49.621Z [WARN] agent: Check socket connection failed: check=service:mesh-gateway-primary error="dial tcp 10.242.89.235:19005: connect: connection refused" 2021-11-08T23:00:49.621818+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:49.621Z [WARN] agent: Check is now critical: check=service:mesh-gateway-primary 2021-11-08T23:00:49.736332+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:49.735Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.71:8302: Remote DC has no server currently reachable 2021-11-08T23:00:50.235931+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:50.235Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.71:8302: Remote DC has no server currently reachable 2021-11-08T23:00:50.736468+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:50.736Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.71:8302: Remote DC has no server currently reachable 2021-11-08T23:00:51.243022+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:51.242Z [INFO] agent.server.serf.lan: serf: Attempting re-join to previously known node: frame-api-gateway10-242-88-147: 10.242.88.147:8301 2021-11-08T23:00:51.736379+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:51.735Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send gossip to 10.253.176.71:8302: Remote DC has no server currently reachable 2021-11-08T23:00:53.235951+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:53.235Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send ping: Remote DC has no server currently reachable 2021-11-08T23:00:54.345660+00:00 frame-consul10-242-89-235 systemd[1]: consul-connect-mesh-gateway.service holdoff time over, scheduling restart. 2021-11-08T23:00:54.347388+00:00 frame-consul10-242-89-235 systemd[1]: Started "HashiCorp Consul - Connect Sidecar Proxy". 2021-11-08T23:00:54.347620+00:00 frame-consul10-242-89-235 systemd[1]: Starting "HashiCorp Consul - Connect Sidecar Proxy"... 2021-11-08T23:00:54.405132+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:54.404Z [INFO] agent: Synced service: service=mesh-gateway-primary 2021-11-08T23:00:54.405947+00:00 frame-consul10-242-89-235 consul[7781]: ==> Registered service: mesh-gateway-primary 2021-11-08T23:00:54.451957+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.451][7781][info][main] [external/envoy/source/server/server.cc:255] initializing epoch 0 (hot restart version=disabled) 2021-11-08T23:00:54.452251+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.451][7781][info][main] [external/envoy/source/server/server.cc:257] statically linked extensions: 2021-11-08T23:00:54.452462+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.451][7781][info][main] [external/envoy/source/server/server.cc:259] envoy.dubbo_proxy.protocols: dubbo 2021-11-08T23:00:54.452690+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.451][7781][info][main] [external/envoy/source/server/server.cc:259] envoy.filters.network: envoy.client_ssl_auth, envoy.echo, envoy.ext_authz, envoy.filters.network.client_ssl_auth, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.http_connection_manager, envoy.filters.network.kafka_broker, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.mysql_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.sni_cluster, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy 2021-11-08T23:00:54.453755+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.451][7781][info][main] [external/envoy/source/server/server.cc:259] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router 2021-11-08T23:00:54.453964+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.451][7781][info][main] [external/envoy/source/server/server.cc:259] envoy.resource_monitors: envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource 2021-11-08T23:00:54.454163+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.451][7781][info][main] [external/envoy/source/server/server.cc:259] envoy.stats_sinks: envoy.dog_statsd, envoy.metrics_service, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.statsd, envoy.statsd 2021-11-08T23:00:54.454376+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.451][7781][info][main] [external/envoy/source/server/server.cc:259] envoy.clusters: envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.dynamic_forward_proxy, envoy.clusters.redis 2021-11-08T23:00:54.454572+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.451][7781][info][main] [external/envoy/source/server/server.cc:259] envoy.dubbo_proxy.serializers: dubbo.hessian2 2021-11-08T23:00:54.454782+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.451][7781][info][main] [external/envoy/source/server/server.cc:259] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.tap, envoy.transport_sockets.tls, raw_buffer, tls 2021-11-08T23:00:54.454986+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.451][7781][info][main] [external/envoy/source/server/server.cc:259] envoy.filters.listener: envoy.filters.listener.http_inspector, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector 2021-11-08T23:00:54.455184+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.451][7781][info][main] [external/envoy/source/server/server.cc:259] envoy.dubbo_proxy.route_matchers: default 2021-11-08T23:00:54.455376+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.451][7781][info][main] [external/envoy/source/server/server.cc:259] envoy.tracers: envoy.dynamic.ot, envoy.lightstep, envoy.tracers.datadog, envoy.tracers.dynamic_ot, envoy.tracers.lightstep, envoy.tracers.opencensus, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin 2021-11-08T23:00:54.455566+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.451][7781][info][main] [external/envoy/source/server/server.cc:259] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts 2021-11-08T23:00:54.455781+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.451][7781][info][main] [external/envoy/source/server/server.cc:259] http_cache_factory: envoy.extensions.http.cache.simple 2021-11-08T23:00:54.455988+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.451][7781][info][main] [external/envoy/source/server/server.cc:259] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter 2021-11-08T23:00:54.456187+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.451][7781][info][main] [external/envoy/source/server/server.cc:259] envoy.udp_listeners: raw_udp_listener 2021-11-08T23:00:54.456376+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.451][7781][info][main] [external/envoy/source/server/server.cc:259] envoy.filters.http: envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.fault, envoy.filters.http.adaptive_concurrency, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cors, envoy.filters.http.csrf, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.dynamo, envoy.filters.http.ext_authz, envoy.filters.http.fault, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.gzip, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.jwt_authn, envoy.filters.http.lua, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.squash, envoy.filters.http.tap, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.gzip, envoy.health_check, envoy.http_dynamo_filter, envoy.ip_tagging, envoy.lua, envoy.rate_limit, envoy.router, envoy.squash 2021-11-08T23:00:54.457461+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.451][7781][info][main] [external/envoy/source/server/server.cc:259] envoy.access_loggers: envoy.access_loggers.file, envoy.access_loggers.http_grpc, envoy.access_loggers.tcp_grpc, envoy.file_access_log, envoy.http_grpc_access_log, envoy.tcp_grpc_access_log 2021-11-08T23:00:54.457694+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.451][7781][info][main] [external/envoy/source/server/server.cc:259] envoy.grpc_credentials: envoy.grpc_credentials.aws_iam, envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata 2021-11-08T23:00:54.457899+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.451][7781][info][main] [external/envoy/source/server/server.cc:259] envoy.thrift_proxy.transports: auto, framed, header, unframed 2021-11-08T23:00:54.458092+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.451][7781][info][main] [external/envoy/source/server/server.cc:259] envoy.retry_priorities: envoy.retry_priorities.previous_priorities 2021-11-08T23:00:54.458284+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.451][7781][info][main] [external/envoy/source/server/server.cc:259] envoy.resolvers: envoy.ip 2021-11-08T23:00:54.458476+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.451][7781][info][main] [external/envoy/source/server/server.cc:259] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.tap, envoy.transport_sockets.tls, raw_buffer, tls 2021-11-08T23:00:54.458680+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.451][7781][info][main] [external/envoy/source/server/server.cc:259] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.udp_proxy 2021-11-08T23:00:54.458888+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.451][7781][info][main] [external/envoy/source/server/server.cc:259] envoy.thrift_proxy.filters: envoy.filters.thrift.rate_limit, envoy.filters.thrift.router 2021-11-08T23:00:54.459072+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.451][7781][info][main] [external/envoy/source/server/server.cc:259] envoy.health_checkers: envoy.health_checkers.redis 2021-11-08T23:00:54.477169+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.476][7781][warning][misc] [external/envoy/source/common/protobuf/utility.cc:198] Using deprecated option 'envoy.api.v2.Cluster.hosts' from file cluster.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details. 2021-11-08T23:00:54.477386+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.476][7781][warning][misc] [external/envoy/source/common/protobuf/utility.cc:198] Using deprecated option 'envoy.api.v2.Cluster.tls_context' from file cluster.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details. 2021-11-08T23:00:54.477996+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.477][7781][info][main] [external/envoy/source/server/server.cc:340] admin address: 127.0.0.1:19000 2021-11-08T23:00:54.478822+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.478][7781][info][main] [external/envoy/source/server/server.cc:459] runtime: layers: 2021-11-08T23:00:54.479026+00:00 frame-consul10-242-89-235 consul[7781]: - name: static_layer 2021-11-08T23:00:54.479242+00:00 frame-consul10-242-89-235 consul[7781]: static_layer: 2021-11-08T23:00:54.479431+00:00 frame-consul10-242-89-235 consul[7781]: envoy.deprecated_features:envoy.config.trace.v2.ZipkinConfig.HTTP_JSON_V1: true 2021-11-08T23:00:54.479630+00:00 frame-consul10-242-89-235 consul[7781]: envoy.deprecated_features:envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager.Tracing.operation_name: true 2021-11-08T23:00:54.479835+00:00 frame-consul10-242-89-235 consul[7781]: envoy.deprecated_features:envoy.api.v2.Cluster.tls_context: true 2021-11-08T23:00:54.480022+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.479][7781][info][config] [external/envoy/source/server/configuration_impl.cc:103] loading tracing configuration 2021-11-08T23:00:54.480208+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.479][7781][info][config] [external/envoy/source/server/configuration_impl.cc:69] loading 0 static secret(s) 2021-11-08T23:00:54.480389+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.479][7781][info][config] [external/envoy/source/server/configuration_impl.cc:75] loading 1 cluster(s) 2021-11-08T23:00:54.491199+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.491][7781][info][upstream] [external/envoy/source/common/upstream/cluster_manager_impl.cc:167] cm init: initializing cds 2021-11-08T23:00:54.493870+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.493][7781][info][config] [external/envoy/source/server/configuration_impl.cc:79] loading 0 listener(s) 2021-11-08T23:00:54.494047+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.493][7781][info][config] [external/envoy/source/server/configuration_impl.cc:129] loading stats sink configuration 2021-11-08T23:00:54.494186+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.493][7781][info][main] [external/envoy/source/server/server.cc:554] starting main dispatch loop 2021-11-08T23:00:54.500989+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.500][7781][info][upstream] [external/envoy/source/common/upstream/cds_api_impl.cc:77] cds: add 11 cluster(s), remove 1 cluster(s) 2021-11-08T23:00:54.550836+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.550][7781][info][upstream] [external/envoy/source/common/upstream/cds_api_impl.cc:93] cds: add/update cluster 'clustereast2.internal.8acb0f4a-71ec-d4f9-6f58-e064dc1d2608.consul' 2021-11-08T23:00:54.606539+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.606][7781][info][upstream] [external/envoy/source/common/upstream/cds_api_impl.cc:93] cds: add/update cluster 'server.clustereast2.consul' 2021-11-08T23:00:54.636235+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.636][7781][info][upstream] [external/envoy/source/common/upstream/cds_api_impl.cc:93] cds: add/update cluster 'server.frame.consul' 2021-11-08T23:00:54.657462+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.657][7781][info][upstream] [external/envoy/source/common/upstream/cds_api_impl.cc:93] cds: add/update cluster 'frame-consul10-242-88-195.server.frame.consul' 2021-11-08T23:00:54.678800+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.678][7781][info][upstream] [external/envoy/source/common/upstream/cds_api_impl.cc:93] cds: add/update cluster 'frame-consul10-242-89-235.server.frame.consul' 2021-11-08T23:00:54.700005+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.699][7781][info][upstream] [external/envoy/source/common/upstream/cds_api_impl.cc:93] cds: add/update cluster 'frame-consul10-242-90-214.server.frame.consul' 2021-11-08T23:00:54.715997+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.715][7781][info][upstream] [external/envoy/source/common/upstream/cluster_manager_impl.cc:145] cm init: initializing secondary clusters 2021-11-08T23:00:54.717832+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.717][7781][info][upstream] [external/envoy/source/common/upstream/cluster_manager_impl.cc:171] cm init: all clusters initialized 2021-11-08T23:00:54.718066+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.717][7781][info][main] [external/envoy/source/server/server.cc:533] all clusters initialized. initializing init manager 2021-11-08T23:00:54.725461+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.724][7781][info][upstream] [external/envoy/source/server/lds_api.cc:76] lds: add/update listener 'lan_ipv4:10.242.89.235:19005' 2021-11-08T23:00:54.725630+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:00:54.724][7781][info][config] [external/envoy/source/server/listener_manager_impl.cc:725] all dependencies initialized. starting workers 2021-11-08T23:00:58.235933+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:00:58.235Z [ERROR] agent.server.memberlist.wan: memberlist: Failed to send ping: Remote DC has no server currently reachable 2021-11-08T23:01:00.389194+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:01:00.388Z [INFO] agent: Synced check: check=service:mesh-gateway-primary 2021-11-08T23:01:00.444601+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:01:00.444Z [INFO] agent.server.gateway_locator: new cached locations of mesh gateways: primary=[10.242.89.235:19005] local=[10.242.89.235:19005] 2021-11-08T23:01:00.648341+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:01:00.648][7781][info][upstream] [external/envoy/source/common/upstream/cds_api_impl.cc:77] cds: add 11 cluster(s), remove 1 cluster(s) 2021-11-08T23:01:00.650121+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:01:00.649][7781][info][upstream] [external/envoy/source/server/lds_api.cc:58] lds: remove listener 'lan_ipv4:10.242.89.235:19005' 2021-11-08T23:01:00.654742+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:01:00.653][7781][info][upstream] [external/envoy/source/server/lds_api.cc:76] lds: add/update listener 'wan_ipv4:10.242.89.235:19005' 2021-11-08T23:01:01.243147+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:01:01.242Z [INFO] agent.server.serf.lan: serf: Attempting re-join to previously known node: frame-rabbitmq10-242-88-148: 10.242.88.148:8301 2021-11-08T23:01:01.960355+00:00 frame-consul10-242-89-235 systemd[1]: Created slice User Slice of root. 2021-11-08T23:01:01.960890+00:00 frame-consul10-242-89-235 systemd[1]: Starting User Slice of root. 2021-11-08T23:01:01.964330+00:00 frame-consul10-242-89-235 systemd[1]: Started Session 167 of user root. 2021-11-08T23:01:01.964827+00:00 frame-consul10-242-89-235 systemd[1]: Starting Session 167 of user root. 2021-11-08T23:01:02.009508+00:00 frame-consul10-242-89-235 systemd[1]: Removed slice User Slice of root. 2021-11-08T23:01:02.009942+00:00 frame-consul10-242-89-235 systemd[1]: Stopping User Slice of root. 2021-11-08T23:01:05.071750+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:01:05.070Z [INFO] agent.server.serf.wan: serf: EventMemberJoin: azureeast2-server-0.clustereast2 10.253.176.44 2021-11-08T23:01:05.072006+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:01:05.070Z [INFO] agent.server: Handled event for server in area: event=member-join server=azureeast2-server-0.clustereast2 area=wan 2021-11-08T23:01:06.470332+00:00 frame-consul10-242-89-235 rsyslogd[616]: cannot connect to frame-rsyslog-sysazure.dev.frame.nutanix.com:514: Connection timed out [v8.1905.0 try https://www.rsyslog.com/e/2027 ] 2021-11-08T23:01:11.243315+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:01:11.243Z [INFO] agent.server.serf.lan: serf: Attempting re-join to previously known node: frame-consul10-242-90-214: 10.242.90.214:8301 2021-11-08T23:01:11.245296+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:01:11.245Z [INFO] agent.server.serf.lan: serf: Re-joined to previously known node: frame-consul10-242-90-214: 10.242.90.214:8301 2021-11-08T23:01:15.820429+00:00 frame-consul10-242-89-235 consul[7764]: 2021-11-08T23:01:15.820Z [INFO] agent: Newer Consul version available: new_version=1.10.3 current_version=1.8.3 2021-11-08T23:01:19.881959+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:01:19.881][7781][info][upstream] [external/envoy/source/common/upstream/cds_api_impl.cc:77] cds: add 11 cluster(s), remove 1 cluster(s) 2021-11-08T23:01:19.883771+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:01:19.883][7781][info][upstream] [external/envoy/source/server/lds_api.cc:58] lds: remove listener 'wan_ipv4:10.242.89.235:19005' 2021-11-08T23:01:19.888406+00:00 frame-consul10-242-89-235 consul[7781]: [2021-11-08 23:01:19.887][7781][info][upstream] [external/envoy/source/server/lds_api.cc:76] lds: add/update listener 'lan_ipv4:10.242.89.235:19005'