Restricting databricks sparks_version

Terraform Providers
1

We are looking to restrict the version of spark which is returned using the databricks data provider, we tried the following which is the current version our deployments use:

data “databricks_spark_version” “latest” {
spark_version = “13.3.x-scala2.12”
depends_on = [
azurerm_databricks_workspace.dbw-edp-uksouth-0001
]
}

However, when running this, we get the following error:

Error: spark versions query returned no results. Please change your search criteria and try again

We’ve also tried spark_version = “13.3” with the same result. Does anyone have a working example of how to restrict the version that’s used?

We are running this in an Azure yml pipeline

Thanks

2

Hey Simon, i am getting this same error, did u find any solution?

3

Unfortunately not, so far we haven’t had any issues allowing the version upgrades, just annoying that there doesn’t seem to be a way to restrict the version.