Terragrunt Tutorial: Create VPC, EKS from Scratch!

Ғылым және технология

🔴 - To support my channel, I’d like to offer Mentorship/On-the-Job Support/Consulting - me@antonputra.com
▬▬▬▬▬ Experience & Location 💼 ▬▬▬▬▬
► I’m a Senior Software Engineer at Juniper Networks (12+ years of experience)
► Located in San Francisco Bay Area, CA (US citizen)
▬▬▬▬▬▬ Connect with me 👋 ▬▬▬▬▬▬
► LinkedIn: / anton-putra
► Twitter/X: / antonvputra
► GitHub: github.com/antonputra
► Email: me@antonputra.com
▬▬▬▬▬▬ Related videos 👨‍🏫 ▬▬▬▬▬▬
👉 [Playlist] Kubernetes Tutorials: • Kubernetes Tutorials
👉 [Playlist] Terraform Tutorials: • Terraform Tutorials fo...
👉 [Playlist] Network Tutorials: • Network Tutorials
👉 [Playlist] Apache Kafka Tutorials: • Apache Kafka Tutorials
👉 [Playlist] Performance Benchmarks: • Performance Benchmarks
👉 [Playlist] Database Tutorials: • Database Tutorials
▬▬▬▬▬▬▬ Timestamps ⏰ ▬▬▬▬▬▬▬
0:00 Intro
02:00 Develop Terraform Code to Create VPC
13:15 Convert VPC Terraform Code into Module
23:46 Use Terragrunt to Create VPC
31:15 Create EKS and Kubernetes Addons Modules
49:54 Production Ready Setup
▬▬▬▬▬▬▬ Source Code 📚 ▬▬▬▬▬▬▬
► GitHub: github.com/antonputra/tutoria...
#terraform #devops #cloud

Пікірлер: 124

  • @AntonPutra
    @AntonPutra8 ай бұрын

    🔴 - To support my channel, I’d like to offer Mentorship/On-the-Job Support/Consulting - me@antonputra.com

  • @gmeister3022
    @gmeister302211 ай бұрын

    People who aren't DevOps engineers might not fully understand the tremendous value you share in your videos. In this video, you intuitively and comprehensively teach Terragrunt, an amazing tool used by some of the best DevOps teams in the industry, and not only that, you use it as an instrument to easily teach advanced AWS topics. If that wasn't enough, you cover the entire scope of infrastructure environments; development, staging, and production. What more can I say other than it's absolutely perfect?

  • @AntonPutra

    @AntonPutra

    11 ай бұрын

    Wow thanks! I appreciate it!

  • @eschult2001
    @eschult20019 ай бұрын

    I've been on the software development (CI) side for 30+ years and only recently had the opportunity to contribute to the CD side of a new startup. Thanks for sharing these great tutorials! Helped me a lot while getting started on my DevOps journey.

  • @AntonPutra

    @AntonPutra

    9 ай бұрын

    Thank you so much!!

  • @cantbefooled8044
    @cantbefooled804410 ай бұрын

    i dont think you understand how much your explanation and combining so many different elements of devops into one video has helped me so much. Like, exactly what i was looking for. thank you so much!

  • @AntonPutra

    @AntonPutra

    10 ай бұрын

    Thank you! Glad to hear that!

  • @sergey_tech
    @sergey_tech8 ай бұрын

    Fantastic video! I truly appreciated the concise and fast-paced explanation. I've liked and subscribed. Thank you!

  • @AntonPutra

    @AntonPutra

    8 ай бұрын

    Thank Sergey!

  • @drystack86
    @drystack86 Жыл бұрын

    Anton you are such a "go-to" guy for this stuff. Keep up the amazing work you are doing for the community. We appreciate you so much. 👊

  • @AntonPutra

    @AntonPutra

    Жыл бұрын

    Thanks Robert!

  • @SuperAleksandar96

    @SuperAleksandar96

    10 ай бұрын

    @@AntonPutra 10/10 videos Thanks

  • @prashlovessamosa
    @prashlovessamosa Жыл бұрын

    Thank you 🙏 for sharing this i was searching about this yesterday and you uploaded this Anton you are great.

  • @AntonPutra

    @AntonPutra

    Жыл бұрын

    My pleasure!

  • @agun21st
    @agun21st Жыл бұрын

    Awesome video for using Terraform Mudule based with Terragrunt and store state in aws S3. I followed all the way and now I am maintaining this infrastructure for my production. Waiting for next video related with this video sir.

  • @AntonPutra

    @AntonPutra

    Жыл бұрын

    Thanks you!

  • @joshualegg3750
    @joshualegg37505 ай бұрын

    Really useful having all this information for a beginner. I was tearing my hair out going from blog post to blog post.

  • @AntonPutra

    @AntonPutra

    5 ай бұрын

    thanks Joshua

  • @umka7536
    @umka753611 ай бұрын

    Thanks a lot for a tutorial that covers Terragrunt from the beginning. Спасибо!

  • @AntonPutra

    @AntonPutra

    11 ай бұрын

    pojaluysta =)

  • @tiagobarreto7853
    @tiagobarreto78535 ай бұрын

    Thank you so much Anton! Amazing knowledge!

  • @AntonPutra

    @AntonPutra

    5 ай бұрын

    Thank you, Tiago!

  • @Wzooff
    @Wzooff Жыл бұрын

    Terragrunt rocks! We use it for managing complex multi-client infra. Bunch of includes, dependencies, etc :) terraform without terragrunt usable only for very simple projects.

  • @AntonPutra

    @AntonPutra

    Жыл бұрын

    agree

  • @jlamoree
    @jlamoree Жыл бұрын

    This is a fantastic tutorial. Extremely helpful to me.

  • @AntonPutra

    @AntonPutra

    Жыл бұрын

    Thank you so much for the support!

  • @ChrisChristensen143
    @ChrisChristensen1438 ай бұрын

    Fantastic video. Thank you so much!

  • @AntonPutra

    @AntonPutra

    8 ай бұрын

    Thank you Chris!

  • @andrestorres7343
    @andrestorres7343 Жыл бұрын

    Top quality, thanks for sharing 🎉

  • @AntonPutra

    @AntonPutra

    Жыл бұрын

    Thank you Andres!

  • @abdallakenawy2855
    @abdallakenawy285510 ай бұрын

    Anton, you are such a great DevOps Engineer ...keep it up, my friend!

  • @AntonPutra

    @AntonPutra

    10 ай бұрын

    Thank you!

  • @tctfone1
    @tctfone1 Жыл бұрын

    Nice video and perfect speed. Spasibo

  • @AntonPutra

    @AntonPutra

    Жыл бұрын

    Spasibo vam =)

  • @AndroMuteli
    @AndroMuteli7 ай бұрын

    спасибо, кучу времени сэкономил)

  • @AntonPutra

    @AntonPutra

    7 ай бұрын

    pojaluysta :)

  • @renatosouza1k
    @renatosouza1kАй бұрын

    This channel is very util. Hello from Brazil.

  • @AntonPutra

    @AntonPutra

    Ай бұрын

    ❤️

  • @vunguyen2246
    @vunguyen22463 ай бұрын

    thank you bro!

  • @MrRin_
    @MrRin_10 ай бұрын

    Great Tutorial, make sure to use the same instance size as in the video and NOT t.2 micro. My autoscaler wouldn't launch and I could not figure out why, now I know that it's the instance size. My guess would be that in order for autoscaler to work - instance size should not be less than t3a.xlarge. Anyway, thanks Anton, I learned a lot

  • @AntonPutra

    @AntonPutra

    10 ай бұрын

    Cool, thanks for the tip

  • @sujithsurendran7686
    @sujithsurendran7686 Жыл бұрын

    Excellent

  • @AntonPutra

    @AntonPutra

    Жыл бұрын

    Thanks

  • @sujithsurendran7686

    @sujithsurendran7686

    Жыл бұрын

    @@AntonPutra can you make some videos on Kubernetes CRD and some automation on that.

  • @AntonPutra

    @AntonPutra

    Жыл бұрын

    @@sujithsurendran7686 Operator is coming soon, but what do you mean by automation?

  • @MisterUsman
    @MisterUsman10 ай бұрын

    Hey Anton, amazing video. The build-up to the final .hcl file put it all together. Can you explain what the differences were between the live-v1/v2/v3/v4 folders and when doing this for a completely different environments, do we need to go through all those steps or can we go straight to v4

  • @AntonPutra

    @AntonPutra

    10 ай бұрын

    Thanks! v1 is just raw terraform code v2 uses terraform modules v2 & v4 both terragrunt and different modules You can go straight to v4 if you use open source modules or build your own and go for v4

  • @lukas-pastva
    @lukas-pastva5 ай бұрын

    AMAZING!!!

  • @AntonPutra

    @AntonPutra

    5 ай бұрын

    Thanks, Lukas!

  • @ethaniel86
    @ethaniel86 Жыл бұрын

    great videos! is there tutorial how to add more kubernetes-addons like aws load balancer controllers, efs csi drivers etc. using this deployment method?

  • @AntonPutra

    @AntonPutra

    Жыл бұрын

    Thanks, sure you just need to add all of your addons in this module - github.com/antonputra/tutorials/tree/main/lessons/160/infrastructure-modules/kubernetes-addons and create a specific variable such as enable_alb_controller.

  • @StephanDuToit
    @StephanDuToit6 ай бұрын

    Thanks!

  • @AntonPutra

    @AntonPutra

    6 ай бұрын

    Thank you, Stephan! I appreciate your support!

  • @MohamedTst-ri3wf
    @MohamedTst-ri3wf21 күн бұрын

    Hi Anton Putra, Thank you for the excellent tutorial on setting up an EKS cluster! It was incredibly helpful and easy to follow. I wanted to ask for your guidance on adding Ubuntu 20.04 nodes to my EKS cluster. Could you provide some instructions or point me towards a resource that explains how to do this? Thanks in advance for your help and for the great content you create!

  • @AntonPutra

    @AntonPutra

    21 күн бұрын

    Sure, you need to build your image using this official packer script - github.com/awslabs/amazon-eks-ami They are called self-managed nodes here is a reference - docs.aws.amazon.com/eks/latest/userguide/worker.html

  • @fedorvinogradov2587
    @fedorvinogradov258711 ай бұрын

    Great tutorial, love it! What do you think of Terraspace?

  • @AntonPutra

    @AntonPutra

    11 ай бұрын

    Thanks! I haven't used Terraspace yet.

  • @YordisPrieto
    @YordisPrieto Жыл бұрын

    55:29 It would be amazing to update the project to do all the terraform IAM setup (showcased at the end using the AWS console) using terragrunt as well.

  • @AntonPutra

    @AntonPutra

    Жыл бұрын

    Thanks for the feedback

  • @idansoffer5675
    @idansoffer567511 ай бұрын

    @AntonPutra in production environment, when you need to upgrade the eks version… will you do that via terraform ..? or thats where terraform ends its job. because i guess upgrading a live eks cluster with deployments is risky . Thanks

  • @AntonPutra

    @AntonPutra

    11 ай бұрын

    Not really, EKS would first drain nodes and respect the constraints that you place. You need to make sure you have pod disruption budgets for all your apps to avoid any downtime. kubernetes.io/docs/tasks/administer-cluster/safely-drain-node/#configure-poddisruptionbudget

  • @devops22
    @devops22 Жыл бұрын

    Amazing Video🌟 got a question, how could Github infra accessed private Github module without a token ?

  • @AntonPutra

    @AntonPutra

    Жыл бұрын

    go to settings and add "deploy key"

  • @dannotes9396
    @dannotes93963 күн бұрын

    Thanks for the video. very insightful.❤ quick query: How can we share values between staging and production using this architecture?

  • @AntonPutra

    @AntonPutra

    3 күн бұрын

    you can use read_terragrunt_config function example: locals { common_vars = read_terragrunt_config(find_in_parent_folders("common.hcl")) } reference - terragrunt.gruntwork.io/docs/reference/built-in-functions/#read_terragrunt_config

  • @fauzuwannazri5267
    @fauzuwannazri52678 ай бұрын

    Hi Anton great tutorial as usual, thanks a lot, but i wanted to ask, how do we handle eks upgrade with terraform , is it enough just by changing the cluster_version and eks will handle the rest, or do we need to do something to scale the cluster first, and do the drain and cordon etc. fact: Putra in my language means prince.

  • @AntonPutra

    @AntonPutra

    8 ай бұрын

    Thank you! Based on my multi-year experience managing Kubernetes clusters in AWS and GCP, sometimes it can be as easy as updating the version and applying Terraform. In that case, Terraform will upgrade the control plane and then node pools one by one (drain, terminate, etc). In some cases, for example, when upgrading to 1.21 or 1.22, there were breaking changes in Kubernetes which forced us to create a brand-new clusters and migrate apps there due to the new and deprecated APIs.

  • @aksel58
    @aksel582 ай бұрын

    hi Antonio, could you please elaborate why you preferred to use folders named by the env name (dev/staging) rather than the terraform workspaces?

  • @AntonPutra

    @AntonPutra

    2 ай бұрын

    There's a significant limitation in how to isolate different environments when using Terraform workspaces. I have a dedicated section somewhere in this video where I explain exactly why you would choose folders rather than workspaces - kzread.info/dash/bejne/eZuFp5pucdSYqpc.html

  • @muhammadzeagham4092
    @muhammadzeagham40927 ай бұрын

    I keep getting cyclic dependency error when I run "terragrunt run-all plan/apply " on dev folder. I downloaded "Anton Putra's" code and and tried running on it and it still gives same error. Can anyone help me. Also I am using local backend and modules.

  • @100faouri
    @100faouri10 ай бұрын

    hi thanks a lot for the video!! can we migrate existing terraform code running on AWS to Terragrunt is that easy to do?

  • @AntonPutra

    @AntonPutra

    10 ай бұрын

    Yes, you can, but it's not easy since you need to import state for all components you already have.

  • @sssanjaya
    @sssanjaya Жыл бұрын

    Hi, do you recommend Terragunt for large scale projects? sometime it becomes hard to maintain.

  • @AntonPutra

    @AntonPutra

    Жыл бұрын

    I do, especially for big companies with lots of environments, but keep it simple and beginner friendly.

  • @haroldsalmazan7261
    @haroldsalmazan72616 ай бұрын

    Very Helpful for beginners like me. Appreciate the effort of posting these. I just have question, when I'm adding the Labels and Taints inside the node_groups, terragrunt doesn't seem to detect it. What should I been missing? I just wanted to add multiple taints and labels for each nodegroup. I haven't added sec group as well to the node group, that will might be same instance.

  • @AntonPutra

    @AntonPutra

    6 ай бұрын

    Thanks! Well you would need to add taints to the module itself here - github.com/antonputra/tutorials/blob/main/lessons/160/infrastructure-modules/eks/3-nodes.tf#L26 Example - github.com/antonputra/tutorials/blob/2d1421a4c6b91e8ee22017f8252aee170586b711/lessons/152/terraform/7-nodes.tf#L98-L102 But instead of hardcoding use github.com/antonputra/tutorials/blob/main/lessons/160/infrastructure-modules/eks/3-nodes.tf#L2 variable

  • @haroldosalmazan

    @haroldosalmazan

    6 ай бұрын

    ​@@AntonPutra Thank you, I was able to add in on the module. However, I'm still trying to figure out how to make an object(taint/labels) inside the node groups to not require an input/s. I have set labels and taints inside the module by using "each.value" but when I skip it on a node group, it fails saying "Unsuitable value for var.node_groups set using the TF_VAR_node_groups │environment variable: all map elements must have the same type." Still looking on what should I have to add to make this possible. Here what I add on module tho, "labels = each.value.labels" taint { key = each.value.taint.key value = each.value.taint.value effect = each.value.taint.effect }

  • @tautvydasbujauskas8104
    @tautvydasbujauskas8104 Жыл бұрын

    Great video, I am managing a few clients but but with only 2 env, so don't see that much gain of Terragrunt, when initial setup and refactoring would be very complex. But information is very valueable. The ideo of using terraform modules like these addons is super, gonna start this from Monday :) Another thing that is still stopping me from using Terrafrunt is using Terraform cloud as backend, since i couldn't find good explaind example. Maybe that could be idea for next video? :)

  • @AntonPutra

    @AntonPutra

    Жыл бұрын

    Thanks, well you can always create your own or try to use www.runatlantis.io

  • @rohanshahi1608
    @rohanshahi1608 Жыл бұрын

    we can use terragrunt to wrap up for a bigger infrastructure on a same cloud provider It can be a library for all resources

  • @AntonPutra

    @AntonPutra

    Жыл бұрын

    agree it's very helpful when you have lots of environments and components

  • @abhishekmurthy5318
    @abhishekmurthy53184 ай бұрын

    How do you reference data blocks that we use to fetch from AWS like authentication credentials in terragrunt?

  • @AntonPutra

    @AntonPutra

    4 ай бұрын

    I didn't get the question. In Terragrunt, we usually create all infrastructure using Terraform itself and use dependency references between different parts of Terragrunt. Data blocks are usually the exception, not the common practice.

  • @festus-obi
    @festus-obi5 ай бұрын

    i'm curious, is there a reason why the tf files were prefixed with numbers ? like the below 0-provider, 1-vpc and so on

  • @AntonPutra

    @AntonPutra

    5 ай бұрын

    It's just for the tutorial to sort them in the IDE and show the logical order of how you would create infrastructure components.

  • @renatosouza1k
    @renatosouza1k22 күн бұрын

    Valeu!

  • @AntonPutra

    @AntonPutra

    22 күн бұрын

    thank you!!

  • @saibd
    @saibd2 ай бұрын

    Do you have any git link to have the code please

  • @rohmersicat3429
    @rohmersicat3429 Жыл бұрын

    Hello master can we do manage own security group instead of using the default one ? and if that so how can i add the security group to use with K8s ?

  • @AntonPutra

    @AntonPutra

    Жыл бұрын

    It creates one for you. You can get id of the group using "cluster_security_group_id" output variable and add additional rules using the following resource "aws_security_group_rule".

  • @rohmersicat3429

    @rohmersicat3429

    Жыл бұрын

    @@AntonPutra yes what i mean if i want to allow port 8080 how can i add it on vpc ?

  • @AntonPutra

    @AntonPutra

    Жыл бұрын

    @@rohmersicat3429 I need to know your use case. For example if you your application (pod) needs access to RDS, you add EKS security groups as source in your configuration. Optionally you can setup Security groups for pods

  • @ianmubangizi
    @ianmubangizi Жыл бұрын

    Amazing!!!

  • @AntonPutra

    @AntonPutra

    Жыл бұрын

    Thanks Ian! =)

  • @pazfelipe
    @pazfelipe11 ай бұрын

    Could you provide this same example but without using terragrunt? Just terraform?

  • @AntonPutra

    @AntonPutra

    11 ай бұрын

    Sure, here for exampe - github.com/antonputra/tutorials/tree/main/lessons/167/terraform Also, I have terraform module version - github.com/antonputra/tutorials/tree/main/lessons/156

  • @mdmoniruzzaman703
    @mdmoniruzzaman7035 ай бұрын

    Hi, in 58:40 when i run terragrunt run-all plan command, it's not working. showing can't read resource with the name of eks

  • @AntonPutra

    @AntonPutra

    5 ай бұрын

    Check if you used the same name for the cluster

  • @pier_x0
    @pier_x0 Жыл бұрын

    thumb up and subscription strictly required!!!

  • @AntonPutra

    @AntonPutra

    Жыл бұрын

    Thanks!

  • @mwanthidaniel1254
    @mwanthidaniel12545 ай бұрын

    Hello, why is my pod not triggering for scale up of the worker nodes, `pod didn't trigger scale-up`.

  • @AntonPutra

    @AntonPutra

    5 ай бұрын

    Best way to find out is to check autoscaler controller logs. Kubectl logs …

  • @AntonPutra

    @AntonPutra

    5 ай бұрын

    Best way to find out is to check autoscaler controller logs. Kubectl logs …

  • @raypi2297
    @raypi2297 Жыл бұрын

    how to know when should use Terragrunt instead Terraform?

  • @AntonPutra

    @AntonPutra

    Жыл бұрын

    when you have more then 2 envs

  • @333HaKan333
    @333HaKan3335 ай бұрын

    Why you wrote your own module instead of using official VPC module ? is there a reason or just for teaching purposes

  • @AntonPutra

    @AntonPutra

    5 ай бұрын

    In the long run it’s much easier to maintain your own resources. Less abstractions less dependencies. I’m talking about 1+ year. Less technical debt you acquire is better for you and your team.

  • @kayoutube690
    @kayoutube6909 ай бұрын

    I think git as a source is difficult to use specially if the organizations are using MFA auth for their git. But over all your video is awesome!

  • @AntonPutra

    @AntonPutra

    8 ай бұрын

    I disagree. GitOps is a standard; even in Google SRE books, they specifically mention following the same git approach.

  • @kayoutube690

    @kayoutube690

    8 ай бұрын

    You're right! But I'm referring only to jenkins. I never use GitOps but i would love to explore this tool.

  • @AntonPutra

    @AntonPutra

    8 ай бұрын

    @@kayoutube690 Due to the recent fork of Terraform to OpenTF, I suggest waiting to see how all those "providers" will be adopted by OpenTF. Terragrunt will no longer be able to use Terraform and will switch to OpenTF because of licensing issues.

  • @coda2k
    @coda2k7 ай бұрын

    Thank you very much for this AMAZING video! If you're creating your cluster in a region other than 'us-east-1', it's necessary to modify the kubernetes-addons/1-cluster-autoscaler.yaml file to add the 'awsRegion' value to the Helm chart, as it defaults to searching for the node group in "us-east-1". Otherwise, you'll get the error "Node ip-xxx.xxxxx.compute.internal should not be processed by the cluster autoscaler (no node group config)"

  • @es3t
    @es3t2 ай бұрын

    11:42 that dev/vpc/dev/vpc/terraform.tfstate file doesn't make completely sense

  • @raypi2297
    @raypi2297Ай бұрын

    Why you have no ".terraform" dir when init ?

  • @AntonPutra

    @AntonPutra

    Ай бұрын

    i believe it's just hidden

  • @xavierordonez2484
    @xavierordonez24849 ай бұрын

    Can you share the code

  • @AntonPutra

    @AntonPutra

    9 ай бұрын

    Sure, you'll find link the video description

  • @xavierordonez2484

    @xavierordonez2484

    9 ай бұрын

    @@AntonPutra please provide email to keep in touch. Some projects I have

  • @user-ck9hd7jv8b
    @user-ck9hd7jv8b Жыл бұрын

    Sorry to say, but you are going very fast and it becomes very hard to understand and have to watch the video repeatedly which is time wasting.But overall your videos are very helpful.

  • @AntonPutra

    @AntonPutra

    Жыл бұрын

    Thanks for the feedback, trying to make them short and concise

  • @timorling5197
    @timorling5197 Жыл бұрын

    If you change the region to something other than `us-east-1`, the autoscaler needs `awsRegion` to be set in `infastructure-modules/kubernetes-addons/1-cluster-autoscaler.tf`

  • @AntonPutra

    @AntonPutra

    Жыл бұрын

    You can set it using this variable - github.com/antonputra/tutorials/blob/main/lessons/160/autoscaller.yaml#L66

  • @timorling5197

    @timorling5197

    Жыл бұрын

    @@AntonPutra How is that yaml file being consumed? Perhaps I needed to re-init terragrunt?

  • @timorling5197

    @timorling5197

    Жыл бұрын

    I figured it out, put the autoscaler.yaml into the `dev/kubernetes-addons/` directory and add the values like normal with `helm_release` `values = [ file("${path.module}/autoscaler.yaml") ]`

Келесі