Error creating azurerm_hdinsight_kafka_cluster for HDInsight on Azure with Terraform

Hi,
I’m currently blocked on a critical issue while provisioning an azurerm_hdinsight_kafka_cluster resource using the latest version of the azurerm provider. Despite following the documented structure for the storage_account block (which does not require a name attribute), the deployment consistently fails with the following error:

Error: Storage account 'name' in storage profile cannot be null or empty

All required values — storage_account_key, storage_container_id, and storage_resource_id — are correctly set and validated, as shown in the Terraform plan. However, the deployment fails with a 400 Bad Request error from Azure.

This issue is blocking the setup of our DTAP (Development, Testing, Acceptance, Production) environments and is time-sensitive.

I have already opened an issue here: Error creating azurerm_hdinsight_kafka_cluster for HDInsight on Azure with Terraform · Issue #29459 · hashicorp/terraform-provider-azurerm · GitHub but haven’t received a response yet.

Could you please assist with reviewing this urgently or advise on a workaround?

Thank you for your support.

Best regards,
Babu Ganesan
Terraform version: 1.11.4
Provider version: v4.27.0
Region: westeurope