Hi, We are upgrading from 0.9.2 to 1.9.5 and some nodes or vm shows or reports that there are members on leaving status but when you ssh to vm that was reported by other vm that is on leaving it shows that is actually alive. Does someone experience that issue. Is this a normal behaviour of consul? Is there any configuration we need to set to avoid it when upgrading. As of now, to resolve it we tried to restart the consul on vm that reports members on leaving status, but it is not an acceptable solution because it can happen in different vm. Below is an example case
vmserv-1 $ consul members
Node Address Status Type Build Protocol DC Segment
vmserv-1 10.12.2.7:8301 alive server 1.9.5 2 dc1
vmserv-2 10.12.1.254:8301 alive server 1.9.5 2 dc1
vmserv-3 10.12.2.18:8301 alive server 1.9.5 2 dc1
accesscontrol-0 10.12.1.251:8301 alive client 1.9.5 2 dc1
accesscontrol-1 10.12.2.14:8301 alive client 1.9.5 2 dc1
vmclient-0 10.12.1.247:8301 alive client 1.9.5 2 dc1
vmclient-1 10.12.2.41:8301 alive client 1.9.5 2 dc1
apserv-0 10.12.2.48:8301 alive client 1.9.5 2 dc1
apserv-1 10.12.2.52:8301 alive client 1.9.5 2 dc1
apserv-1 $ consul members
Node Address Status Type Build Protocol DC Segment
vmserv-1 10.12.2.7:8301 alive server 1.9.5 2 dc1
vmserv-2 10.12.1.254:8301 alive server 1.9.5 2 dc1
vmserv-3 10.12.2.18:8301 alive server 1.9.5 2 dc1
accesscontrol-0 10.12.1.251:8301 leaving client 1.9.5 2 dc1
accesscontrol-1 10.12.2.14:8301 alive client 1.9.5 2 dc1
vmclient-0 10.12.1.247:8301 alive client 1.9.5 2 dc1
vmclient-1 10.12.2.41:8301 alive client 1.9.5 2 dc1
apserv-0 10.12.2.48:8301 alive client 1.9.5 2 dc1
apserv-1 10.12.2.52:8301 alive client 1.9.5 2 dc1
accesscontrol-0 $ consul members
vmserv-1 10.12.2.7:8301 alive server 1.9.5 2 dc1
vmserv-2 10.12.1.254:8301 alive server 1.9.5 2 dc1
vmserv-3 10.12.2.18:8301 alive server 1.9.5 2 dc1
accesscontrol-0 10.12.1.251:8301 alive client 1.9.5 2 dc1
accesscontrol-1 10.12.2.14:8301 alive client 1.9.5 2 dc1
vmclient-0 10.12.1.247:8301 alive client 1.9.5 2 dc1
vmclient-1 10.12.2.41:8301 alive client 1.9.5 2 dc1
apserv-0 10.12.2.48:8301 alive client 1.9.5 2 dc1
apserv-1 10.12.2.52:8301 alive client 1.9.5 2 dc1
vmclient-0 $ consul members
vmserv-1 10.12.2.7:8301 leaving server 1.9.5 2 dc1
vmserv-2 10.12.1.254:8301 alive server 1.9.5 2 dc1
vmserv-3 10.12.2.18:8301 alive server 1.9.5 2 dc1
accesscontrol-0 10.12.1.251:8301 alive client 1.9.5 2 dc1
accesscontrol-1 10.12.2.14:8301 alive client 1.9.5 2 dc1
vmclient-0 10.12.1.247:8301 alive client 1.9.5 2 dc1
vmclient-1 10.12.2.41:8301 alive client 1.9.5 2 dc1
apserv-0 10.12.2.48:8301 alive client 1.9.5 2 dc1
apserv-1 10.12.2.52:8301 alive client 1.9.5 2 dc1