deckhouse icon indicating copy to clipboard operation
deckhouse copied to clipboard

[prometheus] Remove automatic disk expansion

Open vitaliy-sn opened this issue 3 years ago • 3 comments

Description

  • Removed the automatic disk expansion feature.
  • The default size for PersistentVolumeClaim is set to 40GB and retention is set to 80%.
  • Added PrometheusDiskUsage alert with a threshold of 95%.

Why do we need it, and what problem does it solve?

Automatic disk expansion did not work everywhere and caused a lot of questions and misunderstandings.

Changelog entries

section: prometheus
type: chore
summary: Removed the functionality of automatic expansion of disks.

vitaliy-sn avatar Jun 09 '22 07:06 vitaliy-sn

FYI

I've fixed a hook test to pass linter. https://github.com/deckhouse/deckhouse/pull/1743/commits/1033a1fce7e999dc812906df67d2335b42f5d1af

apolovov avatar Jun 17 '22 18:06 apolovov

THere aren't tests for new openapi args.

UPD. There are.

apolovov avatar Jun 17 '22 18:06 apolovov

Rename the hook to smthng like calculate_storage_capacity.

apolovov avatar Jun 17 '22 18:06 apolovov

:green_circle: Deploy web to test for deckhouse:prom-disk-without-autoresize succeeded in 1m8s.

deckhouse-BOaTswain avatar Sep 15 '22 05:09 deckhouse-BOaTswain

:green_circle: Deploy web to test for deckhouse:prom-disk-without-autoresize succeeded in 35s.

deckhouse-BOaTswain avatar Sep 15 '22 05:09 deckhouse-BOaTswain

:red_circle: e2e: GCP for deckhouse:prom-disk-without-autoresize failed in 59s.

Workflow details (1 job failed)

:red_circle: e2e: GCP, Containerd, Kubernetes 1.21 failed in 25s.

deckhouse-BOaTswain avatar Oct 06 '22 07:10 deckhouse-BOaTswain

:green_circle: e2e: GCP for deckhouse:prom-disk-without-autoresize succeeded in 26m42s.

Workflow details

:green_circle: e2e: GCP, Containerd, Kubernetes 1.21 succeeded in 26m7s.

deckhouse-BOaTswain avatar Oct 06 '22 18:10 deckhouse-BOaTswain

:green_circle: e2e: GCP for deckhouse:prom-disk-without-autoresize succeeded in 29m15s.

Workflow details

:green_circle: e2e: GCP, Containerd, Kubernetes 1.21 succeeded in 28m35s.

deckhouse-BOaTswain avatar Oct 07 '22 10:10 deckhouse-BOaTswain