Since the release of 1.10.0, I noticed in our test suite that it nows executes around 2x slower.
Prior to 1.10.0, it took around 19 min to complete all the acceptance testing:
After 1.10.0, now it took roughly twice as long:
I assume this is related to the introduction of Int32 type since OpenTofu does not have it, the elapsed time has not changed (yet).
Is the Terraform SDK team aware of this performance degradation?
There are many steps in the GitHub workflow but the main test step used to take ~15 min:
Afterward, it took ~32 min:
Hi @alexhung 
, can you provide more detail of the two tests you’re using in these comparisons? (GH action link, Terraform versions, etc.)
I assume this is related to the introduction of
Int32type since OpenTofu does not have it, the elapsed time has not changed (yet).
The Int32 framework type is just a wrapper on the Terraform type number, there haven’t been any new types introduced to Terraform, so if the framework upgrade were the root cause of performance issues I’d expect to see similar results regardless of the client executing the test.
Did the version of Terraform change between test A and B? If so, I’d recommend opening a GH issue to discuss that with the Terraform core team.
Here’s the GitHub workflow: Terraform & OpenTofu Acceptance Tests · Workflow runs · jfrog/terraform-provider-artifactory · GitHub
The pre-slowdown test run: Add new resource 'artifactory_vault_configuration' · jfrog/terraform-provider-artifactory@015f608 · GitHub PR: Add new resource 'artifactory_vault_configuration' by alexhung · Pull Request #1008 · jfrog/terraform-provider-artifactory · GitHub using Terraform 1.8.5
The next run: Add events to webhooks · jfrog/terraform-provider-artifactory@52b3aef · GitHub PR: Add events to webhooks by alexhung · Pull Request #1019 · jfrog/terraform-provider-artifactory · GitHub using Terraform 1.9.2
Looks like the Terraform version change from 1.85 → 1.9.2 causes this performance slowdown.
I don’t track the Terraform releases, rather I’ve setup GitHub dependency tracking so the first time I noticed this issue was when Plugin Framework updated.
I’ve created an issue with the core repo: Performance slow down between 1.8.5 and 1.9.2? · Issue #35528 · hashicorp/terraform · GitHub
