Frequent polling for long running requests hits the api rate limit

We are using Terraform with the Azurerm provider to create and maintain AKS clusters. Upgrades to our clusters take a while to complete and because of the frequency of polling by terraform, we are hitting the API rate limits for the subcription leading to errors,

Error: waiting for update of Node Pool: (Agent Pool Name “xxx” / Managed Cluster Name “xxx” / Resource Group “xxx”):
Code=“ReconcileVMSSAgentPoolFailed” Message=“autorest/azure: Service returned an error. Status=429 Code=“OperationNotAllowed”
Message=“The server rejected the request because too many requests have been received for this subscription.”
Details=[{“code”:“TooManyRequests”,“message”:”{\“operationGroup\”:\“HighCostGetVMScaleSet30Min\”,
\“startTime\”:\“2022-02-23T16:27:51.7054661+00:00\”,\“endTime\”:\“2022-02-23T16:30:00+00:00\”,
\“allowedRequestCount\”:900,\“measuredRequestCount\”:981}",“target”:“HighCostGetVMScaleSet30Min”}]
InnerError={“internalErrorCode”:“TooManyRequestsReceived”}"

Is there any way to control the polling duration so we dont hit our limits?