Hi, guys!
I have a direct-put Firehose that delivery data into an iceberg table. Reading the firehose doc, I see that there is a throughput limit of 5MB/s on that type of resource, when writing into iceberg table.
to increase that limit, aws propose either:
- fill a form requesting an increasing to a specific new limit
- or set the flag AppendOnly to true, if this specific firehose is of type append-only, to have it automatically scaling with no limits.
as my usecase is append-only, I would prefer the second option, but terraform doesn’t support that field during creation. any change it will be implemented soon?
from aws doc:
" You can also set the AppendOnly flag to True if you want to only insert data and not perform updates and deletes. By setting the AppendOnly flag to True , Firehose automatically scales to match your throughput. Currently, you can set this flag only with the CreateDeliveryStream API operation."