patternMinor
How fast does Prometheus data grow?
Viewed 0 times
fastprometheusgrowdoeshowdata
Problem
This may sound like a vague question so I will provide some context below. The basic question is :
What parameters describe the growth in size of a Prometheus database over time?
To tie the question down: When will the prometheus time series data base reach 1TB if I collect 10 metrics sampling them at 5 per minute?
What parameters describe the growth in size of a Prometheus database over time?
To tie the question down: When will the prometheus time series data base reach 1TB if I collect 10 metrics sampling them at 5 per minute?
Solution
Prometheus use a timeseries databases with vacuum, the documentation gives some maths to plan your disk consumption:
On average, Prometheus uses only around 1-2 bytes per sample. Thus, to
plan the capacity of a Prometheus server, you can use the rough
formula:
So depending on your retention configuration, 1TB could never be reach or you can keep a very long time. That said it's using prometheus local storage, using another storage system will change the maths depending on the system concerned, influxdb is one of them and has its own documentation about storage.
On average, Prometheus uses only around 1-2 bytes per sample. Thus, to
plan the capacity of a Prometheus server, you can use the rough
formula:
needed_disk_space = retention_time_seconds * ingested_samples_per_second * bytes_per_sampleSo depending on your retention configuration, 1TB could never be reach or you can keep a very long time. That said it's using prometheus local storage, using another storage system will change the maths depending on the system concerned, influxdb is one of them and has its own documentation about storage.
Code Snippets
needed_disk_space = retention_time_seconds * ingested_samples_per_second * bytes_per_sampleContext
StackExchange DevOps Q#5541, answer score: 8
Revisions (0)
No revisions yet.