Postgresql flexible server firewall rule takes too long to create

Before moving to a flexible server, I was using a single server. It would take 20 minutes to provision 18 single servers with the firewall rules. But after moving to flexible, the terraform run takes more than an hour. Is this expected?

azurerm version: 3.72.0