Consul + ALB/ELB shows traffic as coming from the LB instead of the actual clients

We are running consul on EC2 in AWS with an ALB in front of it (previously an ELB with TLS connectivity). In both cases, the debug logs for consul is showing traffic as coming from the Load Balancer IP addresses instead of the actual clients. This means that if one app starts opening too many concurrent connections, we get the 429 errors for everyone because it thinks the client is the LB. Is there a recommendation on how to deal with this?