data-on-eks icon indicating copy to clipboard operation
data-on-eks copied to clipboard

Chore: Kubernetes cluster version upgrades

Open raykrueger opened this issue 1 year ago • 1 comments

Description

The EKS cluster versions in various blueprints are getting a bit behind. We should upgrade all of our blueprints to latest (1.29 at the time of this wrting, 1.30 due soon).

Find them is done as possible. Clone the repo and cd to it.

git clone https://github.com/awslabs/data-on-eks.git
cd data-on-eks

In our blueprints the eks_cluster_version is stored in the variables.tf file. There are other notable version references that should get updated as well.

Find clusters with 1.26

$ git grep "1\.26" -- '*.tf'
analytics/terraform/datahub-on-eks/variables.tf:  default     = "1.26"
schedulers/terraform/managed-airflow-mwaa/variables.tf:  default     = "1.26"

Find clusters with 1.27

$ git grep "1\.27" -- '*.tf'
ai-ml/jark-stack/terraform/eks.tf:      # aws ssm get-parameters --names /aws/service/eks/optimized-ami/1.27/amazon-linux-2/recommended/image_id --region us-west-2
ai-ml/jupyterhub/variables.tf:  default     = "1.27"
ai-ml/mlflow/variables.tf:  default     = "1.27"
ai-ml/trainium-inferentia/eks.tf:      # aws ssm get-parameters --names /aws/service/eks/optimized-ami/1.27/amazon-linux-2/recommended/image_id --region us-west-2
ai-ml/trainium-inferentia/eks.tf:      # aws ssm get-parameters --names /aws/service/eks/optimized-ami/1.27/amazon-linux-2-gpu/recommended/image_id --region us-west-2
ai-ml/trainium-inferentia/eks.tf:      # aws ssm get-parameters --names /aws/service/eks/optimized-ami/1.27/amazon-linux-2-gpu/recommended/image_id --region us-west-2
ai-ml/trainium-inferentia/eks.tf:      # aws ssm get-parameters --names /aws/service/eks/optimized-ami/1.27/amazon-linux-2-gpu/recommended/image_id --region us-west-2
ai-ml/trainium-inferentia/eks.tf:      # aws ssm get-parameters --names /aws/service/eks/optimized-ami/1.27/amazon-linux-2-gpu/recommended/image_id --region us-west-2
analytics/terraform/emr-eks-ack/variables.tf:  default     = "1.27"
analytics/terraform/emr-eks-fargate/variables.tf:  default     = "1.27"
streaming/flink/variables.tf:  default     = "1.27"
streaming/kafka/variables.tf:  default     = "1.27"
streaming/nifi/variables.tf:  default     = "1.27"

And finally, 1.28

$ git grep "1\.28" -- '*.tf'
analytics/terraform/emr-eks-karpenter/variables.tf:  default     = "1.28"
analytics/terraform/spark-k8s-operator/variables.tf:  default     = "1.28"
distributed-databases/pinot/variables.tf:  default     = "1.28"

raykrueger avatar May 08 '24 19:05 raykrueger

Hello, i have raised a PR for the same PR #523

manjarisri avatar May 10 '24 05:05 manjarisri

This issue has been automatically marked as stale because it has been open 30 days with no activity. Remove stale label or comment or this issue will be closed in 10 days

github-actions[bot] avatar Jun 10 '24 00:06 github-actions[bot]

Issue closed due to inactivity.

github-actions[bot] avatar Jun 21 '24 00:06 github-actions[bot]