Thanks @jbardin for the suggestion. I used parallelism but it doesn’t show much difference. It used to take 30 min before but after adding parallelism 20 it takes 29 min 40 sec, parallelism 30 is same around 30 min and parallelism 40 is 31 minutes.
Do you know why it is increasing as we increase the parallelism after certain level?
Secondly, I find the refresh state holds the large chunk of time. I am using a Datadog provider. Does making refresh=false be a good option?
Thanks