Terraform keyvault deployment failed from azure devops

I am trying to deploy keyvault resource using terraform. I am trying the deployment through azure devops pipeline. I have set key vault network acl {bypass:“none”, defaultaction=“deny”, ip_rules=[valid Ips+ azure devops ip] }. I am getting error while terraform plan. error says “making Read request on Azure KeyVault Secret. Client address is not authorized and caller is not a trusted service” InnerError={“code”:“ForbiddenByFirewall”}. I don’t want to change network acl permissions. Is there any way to fix this issue? please suggest.