consul agent baked into AMI bakery and manually launched a instance and connected from bastion using ssh which is basically a consul server. But what we could see couple of agent not started while initiated.
# /usr/local/bin/consul reload
Error reloading: Put http://127.0.0.1:8500/v1/agent/reload: dial tcp 127.0.0.1:8500: connect: connection refused
root@jenkins:/etc/consul.d# systemctl status consul
● consul.service - Consul Agent
Loaded: loaded (/lib/systemd/system/consul.service; enabled; vendor preset: enabled)
Active: activating (auto-restart) (Result: exit-code) since Mon 2024-06-10 14:41:23 UTC; 1min 23s ago
Process: 16090 ExecStartPre=/usr/local/bin/consul validate /etc/consul.d (code=exited, status=1/FAILURE)
Process: 16099 ExecStart=/opt/consul/bin/startc (code=exited, status=1/FAILURE)
Main PID: 16099 (code=exited, status=1/FAILURE)
Jun 10 14:41:23 jenkins-appv2-master startc[16099]: Legacy Token: jenkins-helix-sust-agent
Jun 10 14:41:23 jenkins-appv2-master startc[16099]: Legacy Token: Bootstrap Token
Jun 10 14:41:23 jenkins-appv2-master startc[16099]: consulTokenSearch took 8.58 ms
Jun 10 14:41:23 jenkins-appv2-master startc[16099]: total_time took 286.681691ms
Jun 10 14:41:23 jenkins-appv2-master startc[16099]: Logging failure, not terminating: Post "https://influxdb-metrics-api.sre.apps.fireeye.com:34225/write?db=>
Jun 10 14:41:23 jenkins-appv2-master startc[16099]: END RequestId: 2a9e1f32-ef90-4934-ac21-02d8b8a11be4
Jun 10 14:41:23 jenkins-appv2-master startc[16099]: REPORT RequestId: 2a9e1f32-ef90-4934-ac21-02d8b8a11be4 Duration: 342.35 ms Billed Duration:>
Jun 10 14:41:23 jenkins-appv2-master systemd[1]: consul.service: Main process exited, code=exited, status=1/FAILURE
Jun 10 14:41:23 jenkins-appv2-master systemd[1]: consul.service: Failed with result 'exit-code'.
Jun 10 14:41:23 jenkins-appv2-master systemd[1]: Failed to start Consul Agent.
root@jenkins:/etc/consul.d#
root@jenkinsr:/etc/consul.d# /opt/consul/bin/startc
=== Lambda Logs ===
START RequestId: cc8719d4-aa6e-4679-a6db-63ff901e5139 Version: $LATEST
getMasterToken took 35.51 ms
i-0873862fcc3cf96db Verified OK
Found Consul server at 10.151.196.183
Found 5 server via raft
findConsulServer took 291.18 ms
FindConsulData took 40.27 ms
TLS requires valid certs: false
EstablishConnectionToInflux took 26.91 ms
decorateConfigData took 124.47 ms
Switching: jenkins-xxxx
Actual Lookup jenkins-xxxx
No token found for jenkins-xxxx
Existing: jenkins-build-xxxx
Existing: jenkins-dbre-xxxx