Deletion of `kubernetes_ingress_v1` times out

Hi I created an ingress using kubernetes_ingress_v1 type on my EKS 1.23 cluster. I noticed that when I run terraform destroy the resource does not get cleaned up and only times out. I have to manually delete a load balancer from the console (or via CLI) and remove state of kubernetes_ingress_v1 resources to get past this step. Is there an argument or a workaround to automatically delete a load balancer associated with kubernetes_ingress_v1 on destroy command?