Run Kubernetes Like a Pro—Without the Expertise! Introducing EKS Auto Mode

AWS re:Invent hasn't officially begun, yet there is a game changing new feature to EKS to make you run Kubernetes like a pro!!!

In this blog we will investigate what EKS Auto Mode is all about and try to migrate to our managed node groups workloads to EKS auto mode of an existing cluster but we will be not able to do that, find out why in the blog!

I have also analyzed the price you will pay for EKS Auto v/s the simplicity of operations it provides to help you make an informed decision whether to enable it or not.

I have created a

December 2, 2024 (JST) – Just ahead of re:Invent 2024, AWS released an not yet there so for this blog we will use AWS console.

Cost considerations of this Update

• According to

  
  
  

  :

  
  
  

  
  
  
  Automated Data Plane Components in EKS Auto Mode
  

  
  
  
  
  
  • 
    

    Compute Management: Automates key aspects of cluster compute, including node provisioning, scaling, upgrades, and load balancing, for hassle-free Kubernetes operations.

    
    
    
    
    
    • 
      Nodes:
      
      
      
      
      • Automatically selects optimized AMIs with essential services.
        
      
      
      • Secures nodes using SELinux, read-only root files, and disallowed SSH/SSM access.
        
      
      
      • Includes GPU support for NVIDIA and Neuron GPUs.
        
      
      
      
      
      
      
    
    
    
    • 
      
      Auto Scaling:
      
      
      
      
      • Uses Karpenter to monitor and deploy new nodes for unschedulable Pods.
        
      
      
      • Dynamically terminates unused nodes to optimize resources.
        
      
      
      
      
      
      
    
    
    
    
    
    
  
  
  
  • 
    
    

    Upgrades:

    
    
    
    
    
    • Applies OS and component updates with minimal workload disruption.
      
    
    
    • Enforces a 21-day maximum node lifetime for security and stability.
      
    
    
    
    
    
    
  
  
  
  • 
    
    

    Load Balancing:

    
    
    
    
    
    • Integrates with Elastic Load Balancing (ALB & NLB) for automated provisioning and scaling.
      
    
    
    • Provides production-ready load balancing aligned with AWS best practices.
      
    
    
    
    
    
    
  
  
  
  • 
    
    

    Storage Automation

    
    
    
    
    
    • Configures ephemeral storage with volume settings, encryption, and deletion policies automatically managed for optimal use.
      
    
    
    
    
    
    
  
  
  
  • 
    
    

    Networking Automation

    
    
    
    
    
    • Manages Pod and service connectivity with IPv4/IPv6 support and extends IP spaces using secondary CIDR blocks.
      
    
    
    
    
    
    
  
  
  
  
  
  

  
  
  
  Enabling auto mode on Existing Cluster
  

  
  
  
  
  

  • In this blog we will see how to enable on an existing cluster as

  
  
  
  
  

  
  
  
  Migrations Supported
  

  
  
  

  , to be owned by either self-managed controllers or EKS Auto Mode.

  
  
  

  
  
  
  Prerequisites
  

  
  
  
  
  
  • Updating IAM permissions and configuring core EKS Auto Mode settings
  
  
  • Minimum required version of certain Amazon EKS Add-ons
    Perspective.
  
  
  
  
  

  
  
  
  Updating IAM permissions and configuring core EKS Auto Mode settings
  

  
  
  
  
  
  • Cluster IAM role of an EKS Cluster cannot be changed after the cluster is created. EKS Auto Mode requires additional permissions on this role. You must attach additional policies to the current role.
  
  
  
  
  
  
  
  
  
  • Edit the trust Policy and add sts:TagSession to allow Action.
  
  
  
  
  

  so you don't have to do anything.

• Select Create recommended roles for Node IAM Role




• I am using preconfigured node pool, but you can configure your own using your own yaml file like this

  
  
  
  
  
  • Select default permissions and create role
  
  
  
  
  
  
  
  
  
  • Once enabled you can the auto mode option using Overview Tab in the console
  
  
  
  
  
  
  

  You can disable EKS Auto Mode on an existing EKS Cluster. This is a destructive operation.

  
  
  
  
  

  • EKS will terminate all EC2 instances operated by EKS Auto Mode.

  
  

  • EKS will delete all Load Balancers operated by EKS Auto Mode.

  
  
  
  
  

  
  
  
  Migrate from EKS Managed Node Groups to EKS Auto Mode
  

  
  
  

  
  

  When transitioning your Amazon EKS cluster to use EKS auto mode, you can smoothly migrate your existing workloads from managed node groups using the eksctl CLI tool.

  
  
  

  This process ensures continuous application availability while EKS auto mode optimizes your compute resources. The migration can be performed with minimal disruption to your running applications.

  
  

  
  
  

  
  
  
  Prerequisites
  

  
  
  
  
  

  • Cluster with EKS Auto Mode enabled

  
  

  • eksctl CLI installed and connected to your cluster. For more information, see Set up to use Amazon EKS.

  
  

  • Karpenter is not installed on the cluster.

  
  
  
  
  

  
  
  
  Current state of Pods
  

  
  
  
  
  
  • 2 pods are running on managed node groups.
    
  
  
  
  
  
  
  

  CODE Kopieren

  jatin.mehrotra@CK0662-001 eks-auto-mode % kubectl get po -o wide
  
  NAME                    READY   STATUS    RESTARTS   AGE     IP           NODE                         NOMINATED NODE   READINESS GATES
  
  test-65b7dbddd4-jdxhw   1/1     Running   0          2m29s   10.0.2.52    ip-10-0-2-85.ec2.internal    <none>           <none>
  
  test-65b7dbddd4-lzd4r   1/1     Running   0          2m29s   10.0.1.118   ip-10-0-1-128.ec2.internal   <none>           <none>
  
  

  
  
  
  
  
  
  
  

  , Use the following eksctl CLI command to initiate draining pods from the existing managed node group instances. EKS Auto Mode will create new nodes to back the displaced pods.
  

CODE Kopieren

eksctl update auto-mode-config --cluster eks-auto-test --drain-nodegroup  --region us-east-1 --profile ck-test   

• I thought it's my eksctl version but looks like my eksctl hasn't got update for this flag so far.
  
  
  
  
  
  • my eksctl version output (its the latest version)
    
  
  
  
  
  
  
  

  CODE Kopieren

  eksctl info 
  
  eksctl version: 0.194.0
  
  
  
  

  
  
  
  
  
  
  
  
  
  
  • The other commands for eksctl are running for my cluster so definitely not the connection problem
    
  
  
  
  
  
  
  

  CODE Kopieren

  jatin.mehrotra@CK0662-001 eks-auto-mode % eksctl get addons  --cluster eks-auto-test  --region us-east-1 --profile ck-test 
  
  2024-12-02 12:29:41 [ℹ]  Kubernetes version "1.30" in use by cluster "eks-auto-test"
  
  2024-12-02 12:29:41 [ℹ]  getting all addons
  
  2024-12-02 12:29:44 [ℹ]  to see issues for an addon run `eksctl get addon --name <addon-name> --cluster <cluster-name>`
  
  NAME                            VERSION                 STATUS  ISSUES  IAMROLE UPDATE AVAILABLE                                                                     CONFIGURATION VALUES     POD IDENTITY ASSOCIATION ROLES
  
  amazon-cloudwatch-observability v2.5.0-eksbuild.1       ACTIVE  0
  
  aws-ebs-csi-driver              v1.37.0-eksbuild.1      ACTIVE  0
  
  coredns                         v1.11.1-eksbuild.8      ACTIVE  0               v1.11.3-eksbuild.2,v1.11.3-eksbuild.1,v1.11.1-eksbuild.13,v1.11.1-eksbuild.11,v1.11.1-eksbuild.9
  
  kube-proxy                      v1.30.6-eksbuild.3      ACTIVE  0
  
  vpc-cni                         v1.19.0-eksbuild.1      ACTIVE  0
  
  

  
  
  
  
  
  
  
  

  
  
  
  Investigating the Update the Kubernetes Version of an EKS Auto Mode cluster
  

  
  
  
  
  

  • The compute capability of Amazon EKS Auto Mode controls the Kubernetes version of nodes. After you upgrade the control plane, EKS Auto Mode will begin incrementally updating managed nodes. EKS Auto Mode respects pod disruption budgets.

  
  

  • You do not have to manually upgrade the capabilities of Amazon EKS Auto Mode, including the compute autoscaling, block storage, and load balancing capabilities.

  
  

  • Auto Mode simplifies the version update process by handling the coordination of control plane updates with node replacements, while maintaining workload availability through pod disruption budgets.

  
  

  • When upgrading an Auto Mode cluster, many components that traditionally required manual updates are now managed as part of the service.

  
  
  • 
    

    After you initiate a control plane upgrade, EKS Auto Mode begins replacing nodes in your cluster. The new nodes have the corresponding new Kubernetes version. EKS Auto Mode observes pod disruption budgets when upgrading nodes.

    
    
    
    
    
    • CoreDNS
    
    
    • KubeProxy
    
    
    • AWS Load Balancer Controller
    
    
    • Karpenter
    
    
    • AWS EBS CSI Driver
    
    
    
    
    
    
  
  
  
  • 
    
    

    However You are still responsible for updating:

    
    
    
    
    
    • Apps and workloads deployed to your cluster
    
    
    • Self-managed add-ons and controllers
    
    
    • Amazon EKS Add-ons
    
    
    
    
    
    
  
  
  
  
  
  

  
  
  
  From Solutions Architect Perspective
  

  
  
  
  
  
  • In this blog we saw how EKS Auto mode simplifies Kubernetes operations by offloading infrastructure management to AWS.
  
  
  • It automatically selects the best EC2 instances, optimizes compute costs, and dynamically scales resources based on demand.
  
  
  • This feature enhances security, performance, and availability while reducing the need for deep expertise, capacity planning, and manual management.
  
  
  • But as we saw in the blog its still new feature there might be a need for updates and bug fixes.
    
  
  
  • Yes, its true the its simplifies operations and allows users to run Kubernetes like a PRO in secure manner but you have to pay a price for it.
  
  
  
  
  

  Initially I think this will increase the cost but the real benefits would kick in after a sustained usage to offset the extra price with ease of operations.

  
  
  

  Drop your thoughts in the comments below or connect with me on ! 🚀

  Vollständiger Original-Bericht

  Ausführliche Details, Code-Beispiele & Hersteller-Stellungnahme auf dev.to.

  ↗ Original-Artikel auf dev.to lesen