Building a container from scratch in Go - Liz Rice (Microscaling Systems)

Ғылым және технология

Everyone has heard of Docker, but what is a container? Is it really "a lightweight VM"? In this talk we'll dispel the magic by writing a container in about 100 lines of Go.
Liz Rice has a wealth of software development, team, and product management experience from her years working on network protocols and distributed systems as well as in digital technology sectors including VOD, music, and VoIP. When not building startups and writing code, Liz loves riding bikes in places with better weather than her native London.

Пікірлер: 101

  • @shahmiBro1
    @shahmiBro14 жыл бұрын

    Loving demos cause it shows the real things in practical world, always intrigued to watch her demos;

  • @RichardBuckerCodes
    @RichardBuckerCodes3 жыл бұрын

    The best part of this demo is that it makes containers more like jail and addresses the trust issue.

  • @mattt2684
    @mattt26845 жыл бұрын

    I loved this talk!

  • @afortiorama
    @afortiorama5 жыл бұрын

    This was an excellent presentation, thanks!

  • @gangsterholla179
    @gangsterholla1792 жыл бұрын

    This was amazing. Simple and easy to digest, but packed with information.

  • @jonbv2434
    @jonbv24343 жыл бұрын

    this is by far very short and well explained how the container can expand the possibilities how GO can do it.

  • @artvandelay777
    @artvandelay7776 жыл бұрын

    I finally think I understand what a Docker container is! Thanks.

  • @sussus4914

    @sussus4914

    2 жыл бұрын

    Her 50 lines of GO lang code hides over a 100 levels of OS level abstraction, and you confidently say that you think you understand what a Docker container is. That's laughable.

  • @safiahmed7955

    @safiahmed7955

    Жыл бұрын

    @@sussus4914 so why don’t you give a talk on those 100 lines of OS abstraction?

  • @milanpanic3755

    @milanpanic3755

    4 ай бұрын

    @@sussus4914precisely why they are abstractions, so you don’t get distracted with boilerplate

  • @johnschiwitz4412
    @johnschiwitz44125 жыл бұрын

    one of the best container talk i've heard

  • @HassanSani
    @HassanSani5 жыл бұрын

    Wow the way you make things feel simple, now I'm even a go pro developer

  • @loupax
    @loupax2 жыл бұрын

    Looks like my favorite presentations are those that start so simple you almost think they are jokes, until suddenly they are not.

  • @billvvoods
    @billvvoods2 жыл бұрын

    Awesome video and a great intro to how containers are constructed

  • @iknownothing13
    @iknownothing136 жыл бұрын

    That's very inspiring, especially Liz shows her charm by unique humor and coding flow.

  • @mahdijh1
    @mahdijh13 жыл бұрын

    Thanks, It was the best way someone can show me concept of a container.

  • @abhinjose
    @abhinjose5 жыл бұрын

    Thanks, That was cool and easy to understand!

  • @gscacco
    @gscacco5 жыл бұрын

    Great work !

  • @xinli4938
    @xinli49386 жыл бұрын

    Great Demo!

  • @jasonguo7596
    @jasonguo75965 жыл бұрын

    This is awesome!

  • 6 жыл бұрын

    Great impressive Demo

  • @abstractplanet6018
    @abstractplanet60183 жыл бұрын

    Made me want to learn Go. Thanks.

  • @freakybaby1012
    @freakybaby10123 жыл бұрын

    Great tutorial thank you!

  • @ahmedifhaam7266
    @ahmedifhaam72662 жыл бұрын

    great explanation. Thank you 👍

  • @abhirishi6200
    @abhirishi62006 жыл бұрын

    excellent video

  • @rohitm8526
    @rohitm8526 Жыл бұрын

    Woah... very nice explanation 🔥

  • @izzzzzzza
    @izzzzzzza6 жыл бұрын

    awesome, thanks!

  • @dengan699
    @dengan6995 жыл бұрын

    very good, thanks

  • @hamed775
    @hamed7756 жыл бұрын

    ............Excellent .................

  • @mithleshmeghwal7093
    @mithleshmeghwal70935 жыл бұрын

    awesome lizrice

  • @johnschiwitz4412
    @johnschiwitz44125 жыл бұрын

    hope to see you at kubecon nice video

  • @anshubehera2600
    @anshubehera26003 жыл бұрын

    "You are my peer reviewers"... what a lass

  • @actsrv9
    @actsrv94 жыл бұрын

    All big words should be explained like this.

  • @KeithMakank3
    @KeithMakank32 жыл бұрын

    Really good talk

  • @evilsdexter5261
    @evilsdexter52615 жыл бұрын

    why can't I give 1000 likes to this one? :)

  • @sunwoojang6888
    @sunwoojang68883 жыл бұрын

    really good

  • @reprC
    @reprC4 жыл бұрын

    Awesome stuff. Any reason that calling /proc/self/exe was done rather than syscall.ForkExec? She mentioned that it does the same thing. Just because the copy-paste portion is faster for the demo? Minimizing the Go-specific parts since ForkExec is a convenience method and takes a Go struct? Not criticizing, just curious

  • @liuyanjun6693
    @liuyanjun66936 жыл бұрын

    very impressive demo

  • @generosonunezarias369
    @generosonunezarias3694 жыл бұрын

    Badass!

  • @konstantingeyst4568
    @konstantingeyst45688 ай бұрын

    Note that child processes can call chroot() again and break outside of this container easily. Docker doesn't use chroot.

  • @techindia3602
    @techindia36023 жыл бұрын

    Does anyone have the link to the talk by Julian Friedman she is talking about ?

  • @codelucky
    @codelucky3 жыл бұрын

    Did I just watch Go programing in Downtown Abbey?

  • @chiragsingla.
    @chiragsingla.3 жыл бұрын

    Thanks

  • @MoAliDevOps
    @MoAliDevOps7 жыл бұрын

    The talk really begins at 2:25 You're welcome.

  • @RockwellAIM65
    @RockwellAIM65 Жыл бұрын

    Where is the network stack+virtualization for that? How does that work?

  • @KevinCantwell
    @KevinCantwell7 жыл бұрын

    This is a fantastic presentation, thank you! I notice that you quickly gloss over installing a root file system ("I just happen to have one lying around"). I'm not familiar with installing linux file systems and my attempts at doing so are apparently too naive to work. Is there a straightforward way to download or copy one?

  • @cyphaetus

    @cyphaetus

    7 жыл бұрын

    For ubuntu: apt-get install lxc sudo lxc-create -t ubuntu -n yakkety # now use this for the chroot /var/cache/lxc/yakkety/rootfs-amd64 # I still had to `run mount -t proc proc /proc` to get ps to work though, not sure how to get around that

  • @theoutsider01

    @theoutsider01

    7 жыл бұрын

    I could do this by creating a chroot filesystem. help.ubuntu.com/community/BasicChroot

  • @deepspaceninefreak

    @deepspaceninefreak

    6 жыл бұрын

    debootstrap stretch test1

  • @metaorior
    @metaorior6 жыл бұрын

    good afterneen

  • @derekreed6798
    @derekreed6798 Жыл бұрын

    Nice

  • @TheBendixSA
    @TheBendixSA2 жыл бұрын

    Badass

  • @joepoptiya
    @joepoptiya2 жыл бұрын

    Really good walk through. The container doesn't have internet access. Is there a way to provide the container with internet access?

  • @electricimpulsetoprogramming

    @electricimpulsetoprogramming

    Жыл бұрын

    yes there is a way, how to do that i have no idea

  • @LilRofl
    @LilRofl11 ай бұрын

    🤯

  • @piyushsingh178
    @piyushsingh1782 жыл бұрын

    wow..this is super awesome!! ps not showing host processes was very nice. But why Go though. As someone who doesnt speak Go, what I understood was you did some syscalls, cloned UTS namespace, changed rootdir, and invoked a new /bin/bash as a fork process. Same thing can be done in any language cpp/python/java right?

  • @RockwellAIM65

    @RockwellAIM65

    Жыл бұрын

    Efficiency. You can build a completely self-contained binary that does everything. If you add https or a straight TLS socket you only need the exe and a cert file... it's super clean. With Python you may have versioning/suppor issues. Java is a pig - it latches onto cpu+memory resources. Not really apropos. C++ is ok for this, but younger engineers may not know it + unix command programming in C++ can be a bit tricky. Golang makes it (and certain other tasks) pretty straightforward. I would use either C or golang. Maybe Rust but I don't know it yet.

  • @piyushsingh178

    @piyushsingh178

    Жыл бұрын

    @@RockwellAIM65 yeah I think outside of Go, c++ would be the best choice

  • @RockwellAIM65

    @RockwellAIM65

    Жыл бұрын

    @@piyushsingh178 A C based solution would be clean; you'd have to add lots of external libraries tho' ... would have been nice if C had a standard add-on for managing databases, doing all the simple network type transactions w/ a second thread perhaps (application+background processing thread) + an easy-to-interface string based hierarchical data store. C++ wasn't really necessary... it turned into the Cobol of the 1990s!

  • @obrien8228
    @obrien8228 Жыл бұрын

    wait this is so easy

  • @GerinoMorn
    @GerinoMorn9 ай бұрын

    Why am I watching 7yo video about sth I don't do very often in a language I don't use, I don't know. But it''s good xD

  • @cookiebinary
    @cookiebinary5 ай бұрын

    TL;DR: chroot && mount proc

  • @marccawood
    @marccawood4 жыл бұрын

    I thought Linux supported containers/virtualization natively (LXC) - why is she faking container isolation by e.g. mounting alternative file systems?

  • @l1703

    @l1703

    4 жыл бұрын

    How is she faking it ?

  • @reprC

    @reprC

    4 жыл бұрын

    When did she mount an alternative fs? When she mounted proc? Or do you mean the chroot? The chroot source dir already contains a file system hierarchy because the child process quite literally has a different root, and would not be able to access anything “outside”. Without this, calling /bin/bash would do nothing since that path wouldn’t even exist. Mounting proc is required purely because of the chroot. LXC isn’t a “native” feature, cgroups are. LXC is just one of several system virtualization frameworks such as libvirt or systemd-nspawn. Her talk was about making containers from scratch, which I’ll interpret as a LSB compliant OS with a vanilla Linux kernel. LXC under the hood does pretty much the same thing as her code. Go ahead and check out their github; it’s all open-source. LXC has more features, but I’m pretty sure it’s quite a bit bigger than 60-ish lines

  • @pclokcer
    @pclokcer2 жыл бұрын

    Likee

  • @fardeadok
    @fardeadok5 жыл бұрын

    “Sublime” editor?

  • @maninarush2112

    @maninarush2112

    5 жыл бұрын

    Yis

  • @GreyDeathVaccine
    @GreyDeathVaccine Жыл бұрын

    Too much weird sounds from Liz (don't how to say it since I am not good with english) but good presentation.

  • @SuperMarkusparkus
    @SuperMarkusparkus6 жыл бұрын

    I'm not sure it really explained what a container is or how it works. I just showed what result a few lines of go code had, but what really happened?

  • @kevint6878

    @kevint6878

    5 жыл бұрын

    For me it was the fact that I always sort of imagined containers as this mystical thing. I use them all the time, but I never really thought about how they are created or work under the hood. Seeing this video really opened up my mind to how simple it really is. Of course I know there is so much more to containers than that, but just seeing how she could give the processes their own namespace, their own processes, their own “isolation”, is really interesting and impressive for just 56 lines of code.

  • @foljs5858

    @foljs5858

    4 жыл бұрын

    If you follow what it shows, you'll also see what happened. It gave the program it run isolation (not messing with the environment outside), it's own root (not seeing outside a particular directory), and a few other similar things. That's what a container like Docker does, using several OS provided utilities (like chgroups, chroot, etc), like this program does (in a more basic way)

  • @idiotshypocrites9547
    @idiotshypocrites95472 жыл бұрын

    Min 05:00 and I don't know what the heck she is doing. And yes as she said, this is quite dull. And Go, why?

  • @matthijshebly
    @matthijshebly5 жыл бұрын

    Good presentation. One thing, however: Why the need for go? Couldn't all this have been done in plain bash? After all, all she's doing is calling system commands.

  • @markotikvic

    @markotikvic

    5 жыл бұрын

    Why the need for programming languages at all? After all, all they do is translate human readable code to bunch of machine instructions. Just write those instead.

  • @bt82

    @bt82

    5 жыл бұрын

    Docker is written in go.

  • @kirasan

    @kirasan

    5 жыл бұрын

    She compared the length of her code to Docker's in the end, so it had to be written in Go.

  • @foljs5858

    @foljs5858

    4 жыл бұрын

    Yes, it could be done in plain bash. But it would be hell to maintain, scale, and make able to run arbitrary containers. Whereas this shows how a container manager like Docker does it (of course with much less functionality here), so it can be more easily extended configurable etc.

  • @NyttNorge
    @NyttNorge6 жыл бұрын

    What was the point of this program again?

  • @markotikvic

    @markotikvic

    5 жыл бұрын

    Trust me, nobody is surprised that a flat earth proponent is not able to understand something very basic.

  • @kirasan

    @kirasan

    5 жыл бұрын

    The point was to run a container without docker.

  • @foljs5858

    @foljs5858

    4 жыл бұрын

    Isn't it OBVIOUS? To show how the basics with which a container system like Docker can be implemented...

  • @reprC

    @reprC

    4 жыл бұрын

    What was the point of this comment again?

  • @idiotshypocrites9547
    @idiotshypocrites95472 жыл бұрын

    06:35 cringe, with respect for trying

  • @Jone952
    @Jone9525 жыл бұрын

    Was expecting a token female the managers stuck out front then she started coding live lol

  • @shailynortiz

    @shailynortiz

    3 жыл бұрын

    Very skewed view of the tech world where most of the innovation is done by women since the beginning of the time.

  • @Jone952

    @Jone952

    3 жыл бұрын

    @@shailynortiz def not true

  • @JosueRodriguez08

    @JosueRodriguez08

    3 жыл бұрын

    @@shailynortiz lol, not true

  • @automatic241

    @automatic241

    3 жыл бұрын

    @@shailynortiz I think both views are skewed. Females are not recognized for their accomplishments in the tech world, but saying they've done the majority of innovation in that field is simply not true.

  • @alexwexov4298
    @alexwexov42982 жыл бұрын

    Came for Vim, saw Sublime, leave.

  • @dukearchon
    @dukearchon6 жыл бұрын

    I stopped listening once she said,"... on my Mac..."

  • @snoooters

    @snoooters

    6 жыл бұрын

    that's a cool story

  • @alexkozadaev911

    @alexkozadaev911

    6 жыл бұрын

    You got to be running the TempleOS or something to be that arrogant.

  • @coreyreichle1921

    @coreyreichle1921

    6 жыл бұрын

    Alex Kozadaev nope, just not a proprietary os on proprietary hardware both designed to restrict your freedoms.

  • @coreyreichle1921

    @coreyreichle1921

    6 жыл бұрын

    An Enemy nope. Linux.

  • @alexkozadaev911

    @alexkozadaev911

    6 жыл бұрын

    Corey Reichle makes sense. I also prefer Linux and OpenBSD and cannot see myself ever buying a Mac, however as we can see in this presentation despite of what you said it won’t stand in a way of doing cool stuff either :)

  • @zakariachahboun
    @zakariachahboun2 жыл бұрын

    Thanks

Келесі