CI/CD In 5 Minutes | Is It Worth The Hassle: Crash Course System Design #2

To get better at system design, subscribe to our weekly newsletter: bit.ly/3tfAlYD
Checkout our bestselling System Design Interview books:
Volume 1: amzn.to/3Ou7gkd
Volume 2: amzn.to/3HqGozy
ABOUT US:
Covering topics and trends in large-scale system design, from the authors of the best-selling System Design Interview series.

Пікірлер: 120

  • @TheDerpistan
    @TheDerpistan Жыл бұрын

    Thank you! This is a shockingly well put together and succinct explanation with awesome graphics to reinforce the talk track without bloat. Fantastic work!

  • @zahidulislam2068
    @zahidulislam2068 Жыл бұрын

    As usual, a great overview! Keep up the good work!

  • @sanguchito7381
    @sanguchito7381 Жыл бұрын

    The thing with CI/CD is that it can lead to a hugh bureaucracy overhead. Each of the steps on the pipeline is more often than not, out of reach for a developer and locked away behind a plethora of access request tickets. If you, as a developer, have a issue in one of those steps, you're in for 1-2 weeks of waiting for devops/infra/whoever to sort things out. You are still responsible, but you will not have the tools to fix it. As opposed to other approaches where devops, who has the tools, is also responsible for making things work. Companies seem to think that CD/CI is fire-and-forget miracle solution when in reality, it requires a lot of supervision and revision all the time to insure that it not riddled with roadblocks.

  • @SirRFI

    @SirRFI

    Жыл бұрын

    CI, or more specifically the pipeline on your Git platform, is useful though. As soon someone commits to their Merge Request, tests/builds/others checks are ran. This somewhat forces devs to use code style, linting and tools, and reviewer doesn't have to get their own copy and run these just to be sure. As for "no branches, merge everything into develop branch" or something... yeah, I am not buying it either.

  • @Buffalo5

    @Buffalo5

    Жыл бұрын

    What you explain is not an issue with CI/CD but a concrete (and incorrect) implementation that you probably encountered. A correct implementation would have all necessary build, test and deployment scripts in the same repository as the application and those scripts are constantly exercised (on each commit). If one commit breaks the pipeline (be it a change in code, a test or in the pipeline itself), whoever broked it should either fixit or reverse the commit within 10 minutes. On top of that, companies doing CI/CD would normally be following real agile practices and be structured with small autonomous teams, so in no way they'd have bureaucracy overhead.

  • @sanguchito7381

    @sanguchito7381

    Жыл бұрын

    @@Buffalo5 Yes, that is true. BUT, and here's my beef with CD/CI, under previous "less refined" models, when something was problematic, the people that got screwed were in a position to complain (and be heard) or simply do something about it. That is devops when it was called devops. Nowadays it seems that eventually CD/CI ends up being a mess where if something problematic is going on that delays things, the people that gets screwed (developers) are NOT in a position to do something about it because the pipeline (and products and services acquired to be used in said pipeline) are not their decision or domain either. There's nothing wrong with CD/CI in principle, it's just that it spirals out of control and becomes bottleneck after bottleneck and "it looks alright" from the higherups perspective because "we are following a process". Also, in the past, when things were more manual and less automated, if you had 2 devops for 100 developers (exaggerating of course) you knew you'd have a bottle neck. Now that everything is automated, it appears that you CAN have 2 devops for 100 developers because "everything is automated with our CD/CI pipeline"... until something doesn't work and then you have two poor bastards trying to get things done as fast as possible.

  • @Buffalo5

    @Buffalo5

    Жыл бұрын

    @@sanguchito7381 yeah, of course. At the end, no matter what processes you follow, there are humans involved and that means that what will matter the most is the company culture. It seems that the struggles that you mention come from some misalignments that only people can resolve, not processes.

  • @developersteve1658

    @developersteve1658

    Жыл бұрын

    At my company, we've been (for better or worse) encouraged to adopt nearly the full CI/CD process as part of our scope. Part of building our tool is creating our pipelines, or if we're on the cloud, using terraform to define our architecture.

  • @machinimaaquinix3178
    @machinimaaquinix31786 ай бұрын

    Thank you for this short but very insightful video. The graphics helped explain CI/CD in a way other talking head with static slide videos do not. You got a new sub!

  • @whatuptrav
    @whatuptrav Жыл бұрын

    Really appreciate these abbreviated overviews!! 🎉

  • @kishen2738
    @kishen27387 ай бұрын

    brilliant. clear, concise and a great overview

  • @sk8ergalx
    @sk8ergalx Жыл бұрын

    Thanks so much for your explainer videos! They are very helpful for me as a non technical person who have to work with the devs and engineers

  • @MP-wm9gb
    @MP-wm9gb9 ай бұрын

    Thank you! Thank you! Thank you! Please, don't stop making these videos!

  • @when_life_gives_you_limes
    @when_life_gives_you_limes Жыл бұрын

    Great work with the animations, I love them!

  • @SirRFI
    @SirRFI Жыл бұрын

    4:54 "This effect requires GPU acceleration" 👀

  • @Loppy2345

    @Loppy2345

    Жыл бұрын

    Subliminal advertising for NVidia

  • @DavidsKanal

    @DavidsKanal

    Жыл бұрын

    Plot twist: They deployed this video using CD and didn't catch the errors

  • @SirRFI

    @SirRFI

    Жыл бұрын

    @@DavidsKanal Regression: Add test for blinking in red frames with "This effect requires GPU acceleration"

  • @DavidsKanal

    @DavidsKanal

    Жыл бұрын

    @@SirRFI Regression: Title in video intro says "CI/C in 5D Minutes"

  • @Q_20

    @Q_20

    Жыл бұрын

    @@DavidsKanal 5-dimensional hypertime discovered

  • @El1jahB
    @El1jahB Жыл бұрын

    Beautifully explained overview, I would love to see more content like this for DevSecOps. I’m taking the SANS GIAC course and this ties in perfectly and covers high level gaps.

  • @chrisc9725
    @chrisc972511 ай бұрын

    Great video, really well done. Thank you 🙏🏼

  • @staspanyukov4822
    @staspanyukov4822 Жыл бұрын

    super useful channel! thanks for sharing your knowledge

  • @nessitro
    @nessitro Жыл бұрын

    well made video with beautiful animations which made it even more easier to watch

  • @ac11d
    @ac11d3 ай бұрын

    Thank you so much, you provide such a great quality videos, thank you infinitely

  • @99aabbccddeeff
    @99aabbccddeeff11 ай бұрын

    Thanks for the video! Just short info for people who are not know much about CI/CD. CI/CD is not about tools at all, it's about approach/practice. Tools just help to reach the goal. CI is about continuous integration our changes into a single unit. It's the practice that allow us to integrate many changes made by many people into the single unit. For example in dev area, the unit can be some branch in the git repository. CD is about keeping the unit deployable to the prod environment. It means that our unit should have ready to prod state. It means that where we integrate should have a fully working state.

  • @ankursharma7812
    @ankursharma781219 күн бұрын

    Your video is small & crisp with exact high level information.

  • @thatWebGuySolutions
    @thatWebGuySolutions7 ай бұрын

    Great stuff!

  • @passion4travelling
    @passion4travelling Жыл бұрын

    You explain things so well🎉

  • @stump444555666hhh
    @stump444555666hhh Жыл бұрын

    Great video for learning CI/CD in 5 minutes. Would you recommend a course for learning CI/CD in, say, 5 hours(in depth system design)?

  • @Q_20
    @Q_20 Жыл бұрын

    Thanks for the great explanation

  • @turalnagi
    @turalnagi Жыл бұрын

    Very simple and good explanations

  • @dipkumar
    @dipkumar Жыл бұрын

    Wow! I am a first viewer of this video😅. I must say, the animation is amazing and content is easy to understand! Thanks 😊

  • @syedarmaghanhassan4652
    @syedarmaghanhassan4652Ай бұрын

    This is one of the best channels i knlw. Thanks for sharing. I have an apinion on this CI CD topic. Why would a functional or automation tester ever use CI CD, or any repository other than Jira, or Testcase management tools? This is required for code integration and automated deployment... for developers. A software tester has notving to do with it.. 😅 Testers dont use Guthub/Lab, or any pipeline. Testers use Jira X-Ray, HP Alm, Selenium, Postman, etc.

  • @ovistoica
    @ovistoica Жыл бұрын

    As a beginner youtuber in the programming space, I have to say, I LOVE YOUR EDITING! It seems to take so much effort to animate all these parts. What are you using for that? Thank you for the great information and me personally I would love a deep dive into your youtube creation process

  • @peterstedman6140

    @peterstedman6140

    Жыл бұрын

    They use aftereffects.

  • @prashlovessamosa
    @prashlovessamosa Жыл бұрын

    Thanks for free knowledge

  • @SaroG
    @SaroG Жыл бұрын

    4:53 "This effect requires GPU acceleration." 😄

  • @mainendra
    @mainendra Жыл бұрын

    Awesome 🙌. By the way which tool are you using to create animated diagrams 😬

  • @HenrySuryawirawan
    @HenrySuryawirawan Жыл бұрын

    Great video! A small comment. The original definition of CD should refer to Continuous Delivery, not Deployment.

  • @kyuantym
    @kyuantym Жыл бұрын

    loved your content

  • @Sevius969
    @Sevius969 Жыл бұрын

    Awesome material. Good to know some of the top tools for CI/CD. How to get this picture with the tools?

  • @ganeshsirasapalli
    @ganeshsirasapalli Жыл бұрын

    Great presentation

  • @adibhanna
    @adibhanna Жыл бұрын

    Amazing video! Question: how do you design and create these awesome animations?

  • @ForestValleyGame

    @ForestValleyGame

    Жыл бұрын

    I believe he has a team behind it 😋

  • @tsunghsiwu
    @tsunghsiwu Жыл бұрын

    great animation for easy explanation

  • @jaloliddinruzikulov8279
    @jaloliddinruzikulov827911 ай бұрын

    Thank you for explaining in a nutshell

  • @Ricky-Davis
    @Ricky-Davis Жыл бұрын

    What do you use to make your videos / animations?

  • @nomen_omen
    @nomen_omen Жыл бұрын

    could I please a link or reference to source of ci/cd double loop graphic I would love to read source of this awesome video

  • @zhaofei4256
    @zhaofei42563 ай бұрын

    Great video!Question: how do you design and create these awesome animations? Could you provide some example source element file ? Thanks, pls

  • @vatsalyasinghi438
    @vatsalyasinghi438 Жыл бұрын

    Hi, Please do a video on how webRTC & group video call applications work on large scale.. Thank you.

  • @Glitch-Coder
    @Glitch-Coder Жыл бұрын

    which tools you are using for animation editing ?

  • @rajivraghu9857
    @rajivraghu9857 Жыл бұрын

    How do you create these presentations? Which tool do you use ??

  • @spokesperson_usa
    @spokesperson_usa8 ай бұрын

    The foundational principle of SRE is that developers should be unable to execute their Yaml oriented program without submitting it to another team's rental hardware. The industry standard Yaml first design pattern ensures software engineers will never notice debugging is a forbidden worst practice.

  • @dianpriyambudi
    @dianpriyambudi Жыл бұрын

    Thank you!

  • @amandioreal2293
    @amandioreal22938 ай бұрын

    So, complex system could need same parts of manual deployment?

  • @sarathchandra1087
    @sarathchandra1087 Жыл бұрын

    Great Video . Please talk about redis and its internals in depth if possible

  • @lllllllllllllll9062

    @lllllllllllllll9062

    Жыл бұрын

    Did you hear something? Must've been the wind

  • @sprytnychomik
    @sprytnychomik Жыл бұрын

    I didn't notice any quality improvements in sw (it's slower, more bloated, less intuitive, ad packed), but damn, those frequent deployments are definitely noticeable. This is all software does these days - constantly updates itself.

  • @jozefwoo8079

    @jozefwoo8079

    Жыл бұрын

    Nice take 😂

  • @alibabarahaei2229
    @alibabarahaei22298 ай бұрын

    perfect

  • @severtone263
    @severtone2633 ай бұрын

    Great video

  • @jcwfh
    @jcwfh23 күн бұрын

    Guru, what program do you use for the infographics?

  • @fudosker
    @fudosker Жыл бұрын

    Oooh, I see a meme reference here :D nice job. All dev should now about CI/CD

  • @vultoneo
    @vultoneo Жыл бұрын

    This video effect requires GPU acceleration? @4:52

  • @davidparker5530
    @davidparker5530 Жыл бұрын

    Would love a video covering WebRTC!

  • @VadimTi320
    @VadimTi3207 ай бұрын

    Thanks

  • @joshrampersad4545
    @joshrampersad4545 Жыл бұрын

    What are the frames that say "This effect requires GPU acceleration"?

  • @ARmy2510

    @ARmy2510

    Жыл бұрын

    @@konrness Actually Premiere Pro is for editing. For animation you should use After Effects.

  • @mallipooalwa9085

    @mallipooalwa9085

    Жыл бұрын

    @@ARmy2510 Adobe Animate is used for 2D animations like these.

  • @ARmy2510

    @ARmy2510

    Жыл бұрын

    ​@@mallipooalwa9085 Not everything. Intro itself is a pure AE. Well, all I see here is After Effects :D

  • @87Avantgarde
    @87Avantgarde3 ай бұрын

    Thanks, this kind of helped. It seems like CI CD is something worth looking at when you are a mature dev, right? I am just starting with development, have static website online, and was wondering if I could start now with CI CD. The idea: Whenever I decide to upload the newest changes to my website (which I currently am doing with scp via terminal), I'd like that to happen from...VS Code? Github? At least a lot more automatic than opening terminal and typing that long command.

  • @honeydas5781
    @honeydas5781 Жыл бұрын

    Great content! Am I the only one who read the intro as "CI/C in 5D minutes" 🤔

  • @jondoe8658
    @jondoe8658 Жыл бұрын

    very nice video

  • @fronix5060
    @fronix5060 Жыл бұрын

    My thought is: Automate as much as possible before production. That includes, building, testing and deploying to test/acceptance etc. That's where the fast stuff happens, the quicker you can get something tested and verified the quicker you can move on with your life. Production deployments i take case by case, I always assume it's needs to be manual but with automation until you can "press the button" and go from there.

  • @rajr5936

    @rajr5936

    7 ай бұрын

    Ok, Does it mean not lot of companies are doing automated deployment when it comes to production deployments?

  • @fronix5060

    @fronix5060

    7 ай бұрын

    @@rajr5936 all depends on the size. If it's a large scale distributed system, it's probably fully automated with clusters and everything. But i've worked on a few highly sensitive systems and it was usually 80% manual and 20% automated. We never got to fully automate it...

  • @rajr5936

    @rajr5936

    7 ай бұрын

    @@fronix5060 ok if it's not automated who performs these tasks manually? Still devops eng?

  • @glaze4629
    @glaze4629 Жыл бұрын

    I'm new to this, but why does build goes before testing, shouldn't it the other way around?

  • @benjaminchen8857
    @benjaminchen8857 Жыл бұрын

    4:53 the text that scrolls on screen is "This effect requires GPU acceleration"

  • @robertnull
    @robertnull Жыл бұрын

    What's that about the effect requiring GPU acceleration at 4:51?

  • @shutanovac

    @shutanovac

    Жыл бұрын

    some Adobe Premiere issue that was not caught with the automatic deployment of this video

  • @rajr5936
    @rajr59367 ай бұрын

    Ok so if this is not necessary who and how its deployed?

  • @ddjerqq
    @ddjerqq Жыл бұрын

    4:56 there is an issue with the video?

  • @ComputationalArt
    @ComputationalArt Жыл бұрын

    Is it possible to implement a CI/CD without all these tools in AWS?

  • @chinmayghule8272
    @chinmayghule8272 Жыл бұрын

    I hardly understand these videos since they're high level stuff while I'm still a noob. What part does system design play in web development? I hope you would cover some parts related to web dev.

  • @peterstedman6140

    @peterstedman6140

    Жыл бұрын

    A lot of web app shops use CI/CD, or at least CI as he says.

  • @chinmayghule8272

    @chinmayghule8272

    Жыл бұрын

    @@peterstedman6140 Thank you for the explanation.

  • @gillall4828
    @gillall4828 Жыл бұрын

    I dont like CI online, send things to server, to test, is always slow, I run everything on my machine and after success send to git, the code must be ready to be deployed when uploaded. So deploy to dev/test environment and after, if everything is ok, to prod. Im searching a good set of tools to do the monitoring process.

  • @llothar68
    @llothar68 Жыл бұрын

    In my opinion, no it's not worth on small teams and during the inital development. You can start adding all this stuff for version 3 (remember version 1 is to get out software fast, 2 is to fix the bugs, 3 is to add new surprising ideas). Before that it's a waste of time and money

  • @rajr5936

    @rajr5936

    7 ай бұрын

    Okay. Will these jobs still required manually?

  • @AngelRivera13
    @AngelRivera13 Жыл бұрын

    CircleCI is missing from video

  • @BeeYemerge
    @BeeYemerge Жыл бұрын

    CD means Continuous Delivery #beeyem

  • @kripposoft
    @kripposoft Жыл бұрын

    "This effect requires GPU acceleration"

  • @melvin7103
    @melvin7103 Жыл бұрын

    I freaked out on ""This effect requires GPU acceleration""

  • @nfp613
    @nfp613 Жыл бұрын

    0:07 CI/C in 5D minutes :P

  • @Torotero
    @Torotero5 ай бұрын

    HELP TEAMS SHIP FASTER AND BETTER QUALITY SOFTWARE DEPENDS ON COMPLEXITY OF THE SOFTWARE THAT IS BUILD AND HARDER AND SLOWER TO TROUBLESHOOT / FIX ALL THESE PLATFORM in the same time

  • @meyou118
    @meyou118 Жыл бұрын

    5:40 ish - "this effect requires GPU acceleration"

  • @iyerpram
    @iyerpram Жыл бұрын

    Tracking CICD compliance is another headache. Tracking crazy metrics and trying to achieve unreasonable targets don't make sense.

  • @jasonpaden8641
    @jasonpaden86418 ай бұрын

    This effect requires GPU acceleration

  • @shohaghasan5641

    @shohaghasan5641

    3 ай бұрын

    Nice catch man!

  • @HarrySeldonandI
    @HarrySeldonandI Жыл бұрын

    I think you are missing Harness in a lot of these spaces

  • @rajr5936

    @rajr5936

    7 ай бұрын

    Exactly. It's a revolution tool.

  • @adriatic123
    @adriatic12326 күн бұрын

    Once prog. languages were straight and efficient and everything worked. Today programming environment is so cluttered with so many mostly useless add-ons that it is a miracle if everything works while efficiency has gone thru the window. Popularity of the IT industry and money have lured in so many players that do more damage than good. Bad time to be programmer who has to cope with so many inflated egos

  • @DavidsKanal
    @DavidsKanal Жыл бұрын

    In 5D minutes xDDD

  • @robertnull

    @robertnull

    Жыл бұрын

    CI/C ;)))

  • @user-rv1bx8hx4v
    @user-rv1bx8hx4v5 ай бұрын

    Thank you!

  • @BugaTheKnut
    @BugaTheKnut Жыл бұрын

    This effect requires GPU acceleration