Frequent polling for long running requests hits the api rate limit

We are using Terraform with the Azurerm provider to create and maintain AKS clusters. Upgrades to our clusters take a while to complete and because of the frequency of polling by terraform, we are hitting the API rate limits for the subcription leading to errors,

Error: waiting for update of Node Pool: (Agent Pool Name “xxx” / Managed Cluster Name “xxx” / Resource Group “xxx”):
Code=“ReconcileVMSSAgentPoolFailed” Message=“autorest/azure: Service returned an error. Status=429 Code=“OperationNotAllowed”
Message=“The server rejected the request because too many requests have been received for this subscription.”

Is there any way to control the polling duration so we dont hit our limits?