We were thinking of storing configurations in consul. But our use case requires storing 10Gi+ data as key-value there. There are 5 million keys.
etcd has a storage limit of 8GB, after which performance can take a hit. Consul is a similar system. We are using consul for fewer data use cases at present. Can it support storing 10GBs+ data? Also, this data is going to grow(100GBs in a few years). Is Consul a good database for such use key-value use case?
No, Consul is very much not intended for this use case. All KV data is kept in memory at runtime and periodically snapshotted to disk by rewriting all of it to a flat file.