minio
Document ILM metrics available via Prometheus
Summary We need to document the following metrics related to object lifecycle management available via our metrics endpoint.
minio_cluster_ilm_transitioned_bytes{server="minio3:9000",tier="S3TIER-1"} 1.36317772e+08
minio_cluster_ilm_transitioned_bytes{server="minio3:9000",tier="S3TIER-2"} 2892
minio_cluster_ilm_transitioned_bytes{server="minio3:9000",tier="STANDARD"}
1.3631488e+08
minio_cluster_ilm_transitioned_objects{server="minio3:9000",tier="S3TIER-1"} 1
minio_cluster_ilm_transitioned_objects{server="minio3:9000",tier="S3TIER-2"} 0
minio_cluster_ilm_transitioned_objects{server="minio3:9000",tier="STANDARD"} 1
minio_cluster_ilm_transitioned_versions{server="minio3:9000",tier="S3TIER-1"} 3
minio_cluster_ilm_transitioned_versions{server="minio3:9000",tier="S3TIER-2"} 2
minio_cluster_ilm_transitioned_versions{server="minio3:9000",tier="STANDARD"} 1
Goals
List the in-scope goals
- [ ] Describe the ILM metrics available with examples.
- [ ] Provide guidance on how these metrics could be used to, e.g, 1. project the rate at which the hot-tier is being utilized 2. plan for hot-tier expansion
Non-Goals
List any items that are out of scope
Additional context Feature PR: https://github.com/minio/minio/pull/13413 mc tier info PR: https://github.com/minio/mc/pull/3827
These metrics are also available via mc admin tier info ALIAS.
Sample output
┌──────────┬────────┬────┬───────┬───────┬────────┐
│ Name │ API │Type│ Usage │Objects│Versions│
├──────────┼────────┼────┼───────┼───────┼────────┤
│ STANDARD │internal│hot │130 MiB│ 1 │ 3 │
├──────────┼────────┼────┼───────┼───────┼────────┤
│WARMTIER-1│ s3 │warm│130 MiB│ 1 │ 3 │
├──────────┼────────┼────┼───────┼───────┼────────┤
│WARMTIER-2│ s3 │warm│ 0 B │ 0 │ 0 │
└──────────┴────────┴────┴───────┴───────┴────────┘
@krisis one thought - with this you can't see which buckets have which # of objects or versions right?
@ravindk89 No, you can't. These metrics are aggregate statistics on a per-tier level. They don't retain any information on the buckets these objects are from.
https://min.io/docs/minio/linux/operations/monitoring/metrics-and-alerts.html#lifecycle-management-metrics