Hi Team, I have a question about the size of remote state file. I am using S3 to store the terraform state file. The size of the state file is getting bigger and bigger since we add more and more components into our infrastructure. (Bigger than 5MB) I am curious, if there is any limit of the file s…

I don’t think there’s a hard limit, but as you’ve noticed, performance begins to degrade as it grows. One factor is the whole state file needs to be downloaded before every operation, and uploaded again after every operation that changes it. Another is that as the number of resources in state grow…

@maxb Thanks for the explanation.

Indeed… Terraform itself does not enforce a fixed limit, but there are practical reasons to avoid letting a single state grow excessively large. What qualifies as “excessively large” is hard to pin down exactly because it depends on a bunch of subjective considerations, but it does sound like you’ve…

@apparentlymart Thank you for your suggestion. Of course, I will not let state file increasing to 5TB definitely. But I will consider to both you and @maxb suggestion to break the large Terraform configuration into multiple smaller ones. Do you think keep a state file at around 10MB make sense? Or u…

I think the challenge here is that a “reasonable size” for a state isn’t typically measured in bytes, although of course if the overall size is the main concern then it would be. More commonly I see folks observe that once they have a large number of resource instances in their configuration the “r…

Remote state file size limit?

Terraform

xyfleet November 2, 2022, 2:05am 7

Thanks a lot. It’s a good guide for us to review our projects.

Topic		Replies	Views
Getting error when tfstate is larger than 4MB Terraform Providers	2	5027	February 24, 2020
Terraform remote state tls: oversized record received Terraform	0	279	March 17, 2020
Limitation of Terraform (Azurerm provider) Azure azure	0	599	November 23, 2020
Using Terraform to create remote state resources Terraform	2	964	November 1, 2021
Consul backend tfstate limitations Terraform	2	850	March 2, 2022

Remote state file size limit?

Related topics