🔴 - To support my channel, I’d like to offer Mentorship/On-the-Job Support/Consulting - me@antonputra.com 👉 [UPDATED] AWS EKS Kubernetes Tutorial [NEW]: kzread.info/head/PLiMWaCMwGJXnKY6XmeifEpjIfkWRo9v2l&si=wc6LIC5V2tD-Tzwl

you were born for this. the calmness in your voice made the knowledge transfer so easy and smooth. thanks very much

@AntonPutra

2 жыл бұрын

Thank you so much Gerald! :)

This is a gem of a channel.

@AntonPutra

9 ай бұрын

Thank you!

I am glad that I found your channel and I am learning wonderful things which are helping me to make my day-to--day task super convenient. Appreciate it! :)

@AntonPutra

Жыл бұрын

Thank you!

Such a best explanation i have ever seen...Thanks for putting efforts for sharing the knowledge.

@AntonPutra

3 жыл бұрын

It's my pleasure

Excellent video bro, thanks for sharing this kind of information

@AntonPutra

2 жыл бұрын

Thanks!

👉 How to Manage Secrets in Terraform - kzread.info/dash/bejne/ZYJk1qmEp9molKQ.html 👉 Terraform Tips & Tricks - kzread.info/dash/bejne/aYdtltGOhNyYqpc.html 👉 ArgoCD Tutorial - kzread.info/dash/bejne/rHuixsmdd8SXhMY.html

Kubernetes Horizontal Pod Autoscaler - kzread.info/dash/bejne/on2T0q-spcTgodo.html

🔴UPDATED🔴: How to Create EKS Cluster Using Terraform - kzread.info/dash/bejne/f46t1Nqzkprfcbg.html

@AntonPutra

2 жыл бұрын

Available on December 27

Hi Buddy Thank you so much for the video, its very useful and good to replicate same thing from our real world project.

@AntonPutra

3 жыл бұрын

You are welcome

Thanks! Very useful!

@AntonPutra

2 жыл бұрын

You're welcome!

Working, congrats!!!

@AntonPutra

2 жыл бұрын

thanks!

Very usfull. Thank you.

@AntonPutra

2 жыл бұрын

Thanks Artem! :)

Superb explanation

@AntonPutra

2 жыл бұрын

Thank you 🙂

Thanks you for sharing!

@AntonPutra

2 жыл бұрын

My pleasure!

Thanks man.

@AntonPutra

3 жыл бұрын

No problem!

Very good video. Tku.

@AntonPutra

Ай бұрын

thanks, working on new one that using eks pod identeties

Excellence vedio

@AntonPutra

2 жыл бұрын

Thanks for watching

Excellent video dear!, I have a query, I want to change the type of instance (enlarge its size) of my only node, do you recommend me to do it in the nodegroup.yaml (instanceType:) and redeploy it? Are the changes that I had in my previous Node lost?

@AntonPutra

2 жыл бұрын

Cluster autoscaler can only scale your cluster horizontally. If you just need to update instance type once you can update instance group and perform rolling update

Anton Next video on: Setting up Appmesh in EKS (Fargate) using Helm Chart with Terraform. It has been some time since we visited EKS + Servicemesh (Appmesh).

@AntonPutra

Жыл бұрын

Sure

Great video. If one of nodes goes NotReady status, does Autoscaler do remove and create a new node by automatically?

@AntonPutra

2 жыл бұрын

If the autoscaler drained the node then yes.

Thanks for the video. On which parameters (CPU, Memory ....) does the ASG scales? Can we specify any targets such as CPU > 70% for scale up and CPU < 20% for scale down? If yes, where should be specify them - in yaml or ASG(in console) ?

@AntonPutra

2 жыл бұрын

This particular lesson focus on autoscalling of k8s worker nodes, if you want to scale pods up or down you can use horizontal pod autoscaller. Horizontal pod autoscaller can increase the number of pods based on memory, CPU, or custom metrics, and then if they won't fit into the cluster, Kubernetes autoscaller will create more k8 workers. Kubernetes Horizontal Pod Autoscaler (CPU Utilization | Based on Memory | Autoscaling | HPA | EKS) - kzread.info/dash/bejne/on2T0q-spcTgodo.html Horizontal Pod Autoscaler CUSTOM METRICS & PROMETHEUS: (Kubernetes | EKS | Autoscaling | HPA | K8s) - kzread.info/dash/bejne/m6OY049to9W-cZs.html

@manishc4531

2 жыл бұрын

@@AntonPutra Thanks Anton. I wanted to know on which parameters does the auto scaler scales the number of nodes . To put it other way, when does the auto scaler/ ASG kicks in and does the scale out or scale in of nodes?

@georgecimpoies

2 жыл бұрын

@@AntonPutra I am hesitant to set up the autoscaler in production environment for this exact reason. I want to have a buffer of 50% memory available at all times (because HA is very important and I want to be able to handle surges/memory leaks). I don't want the autoscaler to figure out it can save 1-2 nodes by squeezing all other nodes at 80% capacity and risk running into resource starvation. How can I tell the autoscaler to not scale down in this case? Just by setting the --nodes-min in eksctl?

@AntonPutra

2 жыл бұрын

@@georgecimpoies I would suggest going over the autoscaller configuration is see if one of them suits your needs. github.com/antonputra/tutorials/blob/main/lessons/070/k8s/0-cluster-autoscaler.yaml#L158-L162 github.com/kubernetes/autoscaler/blob/master/cluster-autoscaler/cloudprovider/aws/README.md#common-notes-and-gotchas

Great tutorial. When I scaled down the pods, it not scale down the nodes. Can you explain how can i scale down the nodes when the pods scaled down

@AntonPutra

Жыл бұрын

It just takes a lot of time, but you can see the logic in the controller log.

Hi Anton! When setting up the cluster autoscaler for multiple EKS clusters, is it possible to reuse the same IAM role, or do I need to create individual roles for each cluster? (since each role has a trust relationship with a unique OIDC)

@AntonPutra

2 жыл бұрын

Yes, you must create separate IAM roles if you want to use OIDC. Or you can go with old approach without open id connect provider and attach roles directly to nodes. In that way you can share it between multiple EKS clusters.

@georgecimpoies

2 жыл бұрын

@@AntonPutra thank you!

I have one question I need to install Cluster Autoscaler in Eks cluster but itself needs at least one node to operate In an AWS EKS cluster so that how you can ensure that you have at least one node running when setting up Eks Cluster ? Is it possible to bring up the 1st node using aws fargate on top of that node we can install cluster autoscaler ??

@AntonPutra

8 ай бұрын

1. Autoscaling config has 3 parameters. Desired size, min size and max size. You need to set min size to 1 2. You probably can, but you still need to run some system pods such as dns, why not to use a regular node for that?

Hey Anton, when I create the deployment to test I get pod didn't trigger scale-up: 1 node(s) didn't match Pod's node affinity/selector, do you might know why?

@AntonPutra

Жыл бұрын

if you have nodeselector or affiniti, make sure that you match them with node labels

Hi Anton, good video, is it necessary to have openid connect , can we use our root or admin user for the same ?

@AntonPutra

Жыл бұрын

not necessary, you can create IAM policy and attach it to the IAM role that you're using for k8s workers

@TheNeoamerica

Жыл бұрын

@@AntonPutra ok , thanks, that means i would either need an IAM role and attach the policy and attach the role to k8s worker nodes... yes ?

@AntonPutra

Жыл бұрын

@@TheNeoamerica yes

@TheNeoamerica

Жыл бұрын

@@AntonPutra thanks much appreciate your inputs here ...

hi Anton, thank you for the video, i try to create eks-autoscaler, I follow all the documentation, and at the end i created a test deployment with 50 replicas and it didn't scale up, what could be the issue? and do you have video how to create auto-scaler with terraform? i'm trying to do it automation

@AntonPutra

2 жыл бұрын

The best way to find out is to check cluster-autoscaler logs, is any issues? maybe permission denied?

@radzhivapasov4929

2 жыл бұрын

mojni li s vami po zoomu svyazatsya?

@AntonPutra

2 жыл бұрын

@@radzhivapasov4929 da konechno, mojno libo v pyatnicu ili na vihodnih. me@antonputra - zoom

@radzhivapasov4929

2 жыл бұрын

@@AntonPutra Антон,да было бы круто,дайте мне пожалуйста знать когда вам удобно будет, я могу 24/7

@AntonPutra

2 жыл бұрын

@@radzhivapasov4929 replied in the email

IT is possible to configure Cluster Autoscaler by attaching instance profile to eks worker node group, if I don't want to user OIDC.

@AntonPutra

2 жыл бұрын

Sure, just create role with necessary permissions an attach to the nodes

@KhushbooKumari-qw7nn

2 жыл бұрын

@@AntonPutra but this will not work with kube2iam, as I already tried but it gave error. Anyway thank you for information.

Hi Anton, I have followed the steps exactly as above, but my cluster auto scaler pod runs for a few seconds and goes into CrashLoopBackOff. Any idea?

@AntonPutra

2 жыл бұрын

Hi Sreeram, CrashLoopBackOff means your app (process) exists with status code not equal to 0. To check the last log before crash run "kubectl logs -p "

@sreeramn435

2 жыл бұрын

@@AntonPutra Resolved the issue by increasing the cpu and memory limits for the auto scaler pod. Thanks.

@AntonPutra

2 жыл бұрын

@@sreeramn435 thanks for leetting me know.

Could you please tell how to configure the auto-scaling policy? It’s so confusing. Getting more questions from these tutorials than answers…

@AntonPutra

Жыл бұрын

1. Create EKS with node group where max != min (example - github.com/antonputra/tutorials/blob/main/lessons/166/terraform/2-eks.tf#L15-L16) 2a. Deploy either Autoscaler - github.com/antonputra/tutorials/blob/d09887fa44a415ca1c5a0b80f0eef090dfb692f7/lessons/160/infrastructure-modules/kubernetes-addons/1-cluster-autoscaler.tf#L69-L93 2b. Of karpenter - github.com/antonputra/tutorials/blob/d09887fa44a415ca1c5a0b80f0eef090dfb692f7/lessons/156/terraform/10-karpenter.tf#L22-L29

What about memory... Do this work for memory crunch as well

@AntonPutra

2 жыл бұрын

well, if you have horizontal pod autoscaler deployed in the cluster that can increase number of pods based on the memory usage, then EKS autoscaler will increase number of nodes to fit all containers.

@vijaykumary5427

2 жыл бұрын

@@AntonPutra makes sense...

Hello Anton, I have an error for the pod cluster-autoscaler; Failed to create AWS Manager: cannot auto-discover ASGs: WebIdentityErr: failed to retrieve credentials. Failed to create ASG cache: cannot auto-discover ASGs: WebIdentityErr: was unable to retrieve credentials. thanks

@AntonPutra

Жыл бұрын

Seems to me you misconfigured IAM. Do you use Open id connect provider or attach IAM role/instance to the node?

@nataliarodideal4904

Жыл бұрын

@@AntonPutra Open id Thank for you comment

@nataliarodideal4904

Жыл бұрын

@@AntonPutra I'm still dealing with this problem "cannot autodiscover ASGs: WebIdentityErr:failed to retrieve credentials"

@nataliarodideal4904

Жыл бұрын

And the company has the EKS cluster created manually for every resource, and now, they want to Migrate to terraform for Infrastructure config. Please suggest something on how to this, or maybe do you already have some video about this. Thanks

Repository link please. The one in description is not pointing to any repo.

@AntonPutra

5 ай бұрын

It works for me - github.com/antonputra/tutorials/tree/main/lessons/070

@ajaykharat8832

5 ай бұрын

Thanks , @@AntonPutra It helped .

Can we scale to 0 pods?

@AntonPutra

2 жыл бұрын

I don't think that its possible at this moment - github.com/aws/containers-roadmap/issues/724

I deployed nginx managed deployment yaml file but my pod is not coming up its seems node affinity value (managed-nodes) i changed my self based on my node group name but still pod not coming up. Warning FailedScheduling 18s (x2 over 18s) default-scheduler 0/2 nodes are available: 2 node(s) didn't match Pod's node affinity. Normal NotTriggerScaleUp 8s cluster-autoscaler pod didn't trigger scale-up: 1 node(s) didn't match Pod's node affinity

@AntonPutra

3 жыл бұрын

Please check if your node labels match with node affinity. kubectl get nodes --show-labels

@palanisamy-dl9qe

3 жыл бұрын

@@AntonPutra i have two node with label kubectl label node ip app=backend-heavy kubectl label node ip app=backend-light i have updated node affinity value=backend-light then i deployed nginx pod but still its coming same error

@AntonPutra

3 жыл бұрын

@@palanisamy-dl9qe well, it's hard to debug based on this information. If you can share github repo with your code, it may be easier to help you.

@Anton Putra Could you please do a video to set a CloudWatch alarm when a new node scaled up ?

@AntonPutra

2 жыл бұрын

I guess it's possible, but I won't recommend setting alarms for scaling up/down the cluster. You can just have a Grafana dashboard showing the number of nodes.

@cggirl7481

2 жыл бұрын

@@AntonPutra We already use Grafana. But could you please give me an idea like how this can we set using aws cloudwatch as I don't see any metrices which can be used for this purpose..