Distributed Systems in One Lesson by Tim Berglund

Ғылым және технология

Normally simple tasks like running a program or storing and retrieving data become much more complicated when we start to do them on collections of computers, rather than single machines. Distributed systems has become a key architectural concern, and affects everything a program would normally do-giving us enormous power, but at the cost of increased complexity as well.
Using a series of examples all set in a coffee shop, we’ll explore topics like distributed storage, computation, timing, messaging, and consensus. You'll leave with a good grasp of each of these problems, and a solid understanding of the ecosystem of open-source tools in the space.

Пікірлер: 201

  • @saurabht3540
    @saurabht35403 жыл бұрын

    Tim's lectures are so funny and captivating that I can binge on them instead of Netflix.

  • @vetiarvind
    @vetiarvind2 жыл бұрын

    Tim has a knack for explaining things in a clear and intuitive way. A great teacher, I hope he does more of this. Regards from Chennai.

  • @DevoxxPoland

    @DevoxxPoland

    2 жыл бұрын

    Many thanks!

  • @matheusdallrosa4698
    @matheusdallrosa46983 жыл бұрын

    I don't know if it is a natural skill from this speaker, but he speaks in a very clear way that i can watch the talk in 1.5 speed. Thank you.

  • @PaddleRock
    @PaddleRock5 жыл бұрын

    "I am the very definition of mutable state" Awesome. I think I may need to steal this. Thank you Tim!

  • @amjadk12
    @amjadk125 жыл бұрын

    Amazing single place to know about Distributed system, tools and techniques. Thanks for sharing...

  • @divyeshgaur
    @divyeshgaur5 жыл бұрын

    made it pretty clear from start to end. thank you for sharing.

  • @princejain1101
    @princejain11015 жыл бұрын

    wonderful presenter, great delivery of crisp information.

  • @wishfulbuy
    @wishfulbuy5 жыл бұрын

    A great speaker , at the same time an expert and pro educator :) I love your speech, wish I could have your presentation skills..

  • @bhatanand
    @bhatanand2 жыл бұрын

    Simply love the way Tim Bergland covers the topics. Excellent skills displayed.

  • @DevoxxPoland

    @DevoxxPoland

    2 жыл бұрын

    Many thanks!

  • @Shogoeu
    @Shogoeu4 жыл бұрын

    This talk brings some light into all these technologies and helps decide what to learn next.

  • @amadeus4280
    @amadeus42805 жыл бұрын

    "I like americano today, tomorrow maybe [...] mocca with extra foam - I'm the definition of mutable state" 😂

  • @xueliyue9127

    @xueliyue9127

    3 жыл бұрын

    Mllk

  • @yuvrajjag2558
    @yuvrajjag25582 жыл бұрын

    Love this video ❤️ didn't expect such an amazing content to be available for free. Internet is really a bliss most of the times

  • @DevoxxPoland

    @DevoxxPoland

    2 жыл бұрын

    Glad you enjoyed it!

  • @Samarpanrai94

    @Samarpanrai94

    Жыл бұрын

    Well the idea is that you later go buy Confluent’s services 😉 Kafka is a monster to maintain yourself

  • @limouwang5376
    @limouwang53765 жыл бұрын

    I love this guy. Cristal clear and definitely he loves distributed systems.

  • @andersondantas2010
    @andersondantas20103 жыл бұрын

    Thanks for the lessons m Berglund. This was by far one of the educating 40 minutes I had in years. I'd like to thank you for sharing your knowledge.

  • @DevoxxPoland

    @DevoxxPoland

    3 жыл бұрын

    Glad it was helpful!

  • @soggie7157
    @soggie71575 жыл бұрын

    Gavin Belson? :O

  • @kevinjom1117

    @kevinjom1117

    5 жыл бұрын

    Lol

  • @rayhanmahmudshihab

    @rayhanmahmudshihab

    5 жыл бұрын

    :xD Haha... I got confused after seeing this comment :p

  • @MayurPatil

    @MayurPatil

    5 жыл бұрын

    Dude same here ! I also thought on what earth Gavin Belson is here...

  • @robsciuk729

    @robsciuk729

    5 жыл бұрын

    Yeah. You kind of nailed it. ;-)

  • @abod4gamer

    @abod4gamer

    5 жыл бұрын

    WTF lol hooli

  • @NOCDIB
    @NOCDIB4 жыл бұрын

    Great introduction to Distributed Systems. So often the industry gets bogged down in buzzwords and cliche terms that newcomers find it difficult to know where to begin. This is a great starting point.

  • @heh2k

    @heh2k

    2 жыл бұрын

    Marketing loves to obfuscate.

  • @cihadguzel2159
    @cihadguzel21593 жыл бұрын

    He had worked in cassandra in earlier and now for kafka. Dude, you are the evolution of the distributed systems.

  • @StanislavKozlovsk
    @StanislavKozlovsk6 жыл бұрын

    What a great speaker

  • @PakluPapito

    @PakluPapito

    4 жыл бұрын

    very concise and to the point !

  • @hellelo.5840

    @hellelo.5840

    4 жыл бұрын

    This is Jeff Winger fron Community tv show LOL

  • @vardaansharma178

    @vardaansharma178

    3 жыл бұрын

    Same thoughts.

  • @tachnicalcorner970

    @tachnicalcorner970

    2 жыл бұрын

    @@hellelo.5840 d d. Nnfnd. F d. De. D. N n. D nd. B ndd nn. D y b. D dd d. De. D. Fb. D. D. D. D. L D. D. De. D. Ddn.. D. F d f. DIY d. Xl dd. D d. D d d. D d. Dad d d d d d. D. D. D d. D d

  • @tachnicalcorner970

    @tachnicalcorner970

    2 жыл бұрын

    @@hellelo.5840 d d. Nnfnd. F d. De. D. N n. D nd. B ndd nn. D y b. D dd d. De. D. Fb. D. D. D. D. L D. D. De. D. Ddn.. D. F d f. DIY d. Xl dd. D d. D d d. D d. Dad d d d d d. D. D. D d. D d. Y d. Fu d

  • @wittyhumour29
    @wittyhumour29 Жыл бұрын

    Great introduction to Distributed Storage, Computation, & Messaging.

  • @DevoxxPoland

    @DevoxxPoland

    Жыл бұрын

    Glad you liked it

  • @sujaikumarj07
    @sujaikumarj07 Жыл бұрын

    Great content on introduction to Distributed Computing. I enjoyed the session. Thank you Tim.

  • @DevoxxPoland

    @DevoxxPoland

    Жыл бұрын

    Glad it was helpful!

  • @vedambala
    @vedambala2 жыл бұрын

    A great piece of presentation from a great speaker.

  • @rockinray6197
    @rockinray61973 жыл бұрын

    I was inspired by this and another talk about system design (parking lot with premier parking spaces). I n your honor I am adding an external drive, for the hidden- read/write copy of a groupware system with an asynchronous don't ask don't tell, storage management unit. The best i ever had... The best i ever had ......

  • @mahiprabhanjan
    @mahiprabhanjan3 жыл бұрын

    Great speaker n teacher! Thanks for sharing!

  • @nceevij
    @nceevij5 жыл бұрын

    Awesome talk, great learning on distributed systems

  • @huntrz
    @huntrz2 жыл бұрын

    the original lesson is on Oreilly and its amazing

  • @mitalivarshney5168
    @mitalivarshney51685 жыл бұрын

    Amazingly explained. Interesting speaker :)

  • @deadleaves1985
    @deadleaves19854 жыл бұрын

    Excellent speaker, that was pure joy

  • @michaelzion8024
    @michaelzion80243 жыл бұрын

    Really enjoyed listening to this lecture, thanks :)

  • @srbwin1
    @srbwin15 жыл бұрын

    Great job Tim, nice stuff.!!

  • @korniszon68
    @korniszon684 жыл бұрын

    Nice talk. It feels like watching a good movie :)

  • @arifrazakh
    @arifrazakh6 жыл бұрын

    Thanx sir very helpful..

  • @_rshiva
    @_rshiva5 жыл бұрын

    one hell of insight full talk on distributed system

  • @yousefkhanbabaei4850
    @yousefkhanbabaei48502 жыл бұрын

    Presentation was great and explanation was clear. Thank you!

  • @DevoxxPoland

    @DevoxxPoland

    2 жыл бұрын

    Glad you enjoyed it!

  • @akshitg
    @akshitg5 жыл бұрын

    It was a very good lecture. Thanks for the talk

  • @tommysuriel
    @tommysuriel2 жыл бұрын

    Best explanation of Cassandra and consistent Hashing in all of KZread

  • @DevoxxPoland

    @DevoxxPoland

    2 жыл бұрын

    Thank you

  • @rameshdahiya4615
    @rameshdahiya46155 жыл бұрын

    Thats a great insight on distributed systems. One thing at 42:00 Tim mentioned about consistent hashing, where as in example of topic partitioning he used modules operation, which doesn't derive consistent hashing.

  • @pavansrinivas4388
    @pavansrinivas43886 жыл бұрын

    Great presentation

  • @hrishikeshkaulwar8120
    @hrishikeshkaulwar81204 жыл бұрын

    Can you share the link to the 4-hour lecture about distributed systems you mentioned in the start, please?

  • @adarshsunilkumar7095
    @adarshsunilkumar70954 жыл бұрын

    great video, awesome explanation

  • @zss123456789
    @zss1234567894 жыл бұрын

    4:29 I thought my laptop was being possessed by Satan for a second.

  • @theritesh973
    @theritesh97310 ай бұрын

    Great presentation👏

  • @selvalooks
    @selvalooks3 жыл бұрын

    Thanks , its a great session !!!

  • @coding3438
    @coding3438 Жыл бұрын

    Can we have the link to the 3-4 hr long video Tim talked about?

  • @MrChandrasekar1
    @MrChandrasekar13 жыл бұрын

    very well explained core concepts and problems about distributed systems, thanks Tim

  • @DevoxxPoland

    @DevoxxPoland

    3 жыл бұрын

    Glad you enjoyed it!

  • @bocckoka
    @bocckoka4 жыл бұрын

    he has good explanations

  • @dariuszruminski8549
    @dariuszruminski85494 жыл бұрын

    "zed's dead" - the audience didn't get this. Hope so I did :)

  • @AbhishekSingh-op2tr
    @AbhishekSingh-op2tr4 жыл бұрын

    He is also Hooli's CEO.

  • @philodev874

    @philodev874

    3 жыл бұрын

    This is correct

  • @johannsebastianbach3411
    @johannsebastianbach34113 жыл бұрын

    As a full stack developer who does stand up on the side, gotta say that was one tough crowd :D

  • @tanveerhasan2382

    @tanveerhasan2382

    2 жыл бұрын

    Sad

  • @calvincruzada1016
    @calvincruzada10164 жыл бұрын

    Excellent speaker holy moly.

  • @DavenH
    @DavenH3 жыл бұрын

    Awesome speaker. Wish I could deliver talks in this manner.

  • @DevoxxPoland

    @DevoxxPoland

    Жыл бұрын

    Love him as well

  • @ramkumarnj7617
    @ramkumarnj76176 жыл бұрын

    very inspiring!

  • @skyFullOfStars
    @skyFullOfStars5 жыл бұрын

    45:37 "They say the best code is the code you never write and the worst code would be the code you write two or more times" 👏

  • @snarkyboojum

    @snarkyboojum

    4 жыл бұрын

    Akshay AS except good code is usually rewritten until it’s great, so this isn’t quite true.

  • @bendakai1
    @bendakai14 жыл бұрын

    Instant like for over simplified CAP theorem at 20:00

  • @alirezaghanbarzadeh1679
    @alirezaghanbarzadeh16794 жыл бұрын

    Tim is amazing

  • @sifiso5055
    @sifiso50554 жыл бұрын

    Such a powerful video

  • @lalwho
    @lalwho4 жыл бұрын

    Anyone else noticed: "Kakfa" in the heading of the slide :O..

  • @franklemanschik4862

    @franklemanschik4862

    4 жыл бұрын

    ya thats awsome

  • @aleksar6755

    @aleksar6755

    3 жыл бұрын

    Amazing

  • @btm1
    @btm12 жыл бұрын

    great presentation, thank you!

  • @DevoxxPoland

    @DevoxxPoland

    2 жыл бұрын

    Glad it was helpful!

  • @spicytuna08
    @spicytuna085 жыл бұрын

    i didn't know about all these pain involved with distributed system.

  • @HienNguyenTechIO
    @HienNguyenTechIO3 жыл бұрын

    Very good presentation

  • @mvlad7402
    @mvlad74024 жыл бұрын

    great content!

  • @vishnusingh4118
    @vishnusingh41184 жыл бұрын

    10:03 picks up bottle. 10:08 opens it to drink water (presumably) 10:24 shuts and keeps it back without drinking

  • @philosophyofpolitics4504

    @philosophyofpolitics4504

    4 жыл бұрын

    Haha that's swag

  • @ironhide9955

    @ironhide9955

    4 жыл бұрын

    23:28

  • @SiddharthKulkarniN
    @SiddharthKulkarniN6 жыл бұрын

    Nice talk.

  • @hidayaturrahman7897
    @hidayaturrahman78974 жыл бұрын

    Really appreciated very nice

  • @raghavendrakrishnamurthy4041
    @raghavendrakrishnamurthy40412 жыл бұрын

    Great lecture!

  • @DevoxxPoland

    @DevoxxPoland

    2 жыл бұрын

    Thank you!

  • @Kydomusic
    @Kydomusic3 жыл бұрын

    nice talk thank you!

  • @stdiosus
    @stdiosus4 жыл бұрын

    Super cool presentation. I am also not a fan of football, but I like Cervantes, so my favorite football club is Real Madrid.

  • @Amittai_Aviram
    @Amittai_Aviram3 жыл бұрын

    Misspelled Kafka ("kakfa") on the slide at 34:10.

  • @maslina10
    @maslina104 жыл бұрын

    Question on Topic Partitioning (at 41:00): together with each message, can we not include the timestamp when it was produced? Wouldn't it provide the global ordering?

  • @adityagoel123able
    @adityagoel123able2 жыл бұрын

    awesome talk.

  • @shivajireddy5959
    @shivajireddy59594 жыл бұрын

    You can skip to 2:47 if you want.

  • @philosophyofpolitics4504

    @philosophyofpolitics4504

    4 жыл бұрын

    Dude... F*** you...

  • @smithcodes1243
    @smithcodes12432 жыл бұрын

    Tim's a beauty.

  • @DevoxxPoland

    @DevoxxPoland

    2 жыл бұрын

    Thanks

  • @IbnIbrahem
    @IbnIbrahem4 жыл бұрын

    One of few people where you can run the video at 2x speed and still understand what he is saying.

  • @tedwatts5021

    @tedwatts5021

    3 жыл бұрын

    That's not a good thing

  • @sashwatp
    @sashwatp4 жыл бұрын

    Can someone point me to the link for the 4 hr video, he referenced to?

  • @jonathanlowe8755

    @jonathanlowe8755

    4 жыл бұрын

    Also interested.

  • @prakritidevverma
    @prakritidevverma3 жыл бұрын

    Its really a good talk...

  • @pradeepsanchana
    @pradeepsanchana6 жыл бұрын

    Nice talk..

  • @harishkumarrayasam
    @harishkumarrayasam3 жыл бұрын

    Very nice explanation

  • @DevoxxPoland

    @DevoxxPoland

    3 жыл бұрын

    Thanks for liking

  • @robotempire
    @robotempire2 жыл бұрын

    Love this video as I prepare for sys design interview

  • @DevoxxPoland

    @DevoxxPoland

    2 жыл бұрын

    Glad it helped you.

  • @drdzdd
    @drdzdd4 жыл бұрын

    great talk

  • @sun-ship
    @sun-shipАй бұрын

    Very clear

  • @mantistoboggan537
    @mantistoboggan5374 жыл бұрын

    Is "read replication" synonymous with multiversion concurrency control? Meaning, you have different versions of data items for each transaction that are distinguished by time stamp, and therefore avoiding conflicts?

  • @heh2k

    @heh2k

    2 жыл бұрын

    No, it means a given version has X identical redundant copies.

  • @heh2k

    @heh2k

    2 жыл бұрын

    and they're usually kept on separate servers, racks, or data centers.

  • @ironhide9955
    @ironhide99554 жыл бұрын

    23:00 about cap theorem.. did he confuse himself?

  • @reespozzi4334

    @reespozzi4334

    3 жыл бұрын

    He almost made it seem like by not having availability, you would also lose consistency, but what he means is, if the node just doesn't respond, it's still consistent because it's not giving out bad/inconsistent data. In a big distributed system, this data could be retrieved from elsewhere while tolerating the consistency.

  • @kahnfatman
    @kahnfatman Жыл бұрын

    All this Hadoop/Spark thingy are so abstract that I have no clue what is what anymore. 🤣😂

  • @Saurabh2816
    @Saurabh281611 ай бұрын

    17:00 that order though

  • @Tridib_Tinkel
    @Tridib_Tinkel4 жыл бұрын

    33:05 kakfa

  • @imranariffin2688
    @imranariffin26885 жыл бұрын

    6:41 "In a relational database, reads are usually than writes" I don't understand this. I thought reads are generally more expensive since you might have joins? While when writing you typically add some rows to a single table and that's it. Can somebody help explain it to me?

  • @imranariffin2688

    @imranariffin2688

    5 жыл бұрын

    Or I guess it's because in a distributed system you have to synchronize the writes to other machines?

  • @melter2973

    @melter2973

    5 жыл бұрын

    I think he meant more reads than writes in terms of volume.

  • @snarkyboojum

    @snarkyboojum

    4 жыл бұрын

    Because OLTP databases do a great job of caching and using indexes to optimise read. Even the storage characteristics and disk layout is usually optimised for read traffic.

  • @btm1

    @btm1

    2 жыл бұрын

    He meant there are usually more reads than writes, this is why the first step is to have some replicas to use for the reads

  • @Roshen_Nair
    @Roshen_Nair3 жыл бұрын

    Continue watching: 12:42

  • @ishanksharma2785
    @ishanksharma27853 жыл бұрын

    What if I tell you that you read 'kakfa' as 'kafka' 33:07

  • @bocckoka
    @bocckoka4 жыл бұрын

    apache sparkling water?

  • @subvind
    @subvind5 жыл бұрын

    33:03 kafka is not spelled correctly at the top there

  • @kevintran6102
    @kevintran61023 жыл бұрын

    Why still water over sparkling water?

  • @BharCode09
    @BharCode094 жыл бұрын

    "I draw examples from a coffee shop just to be cute". Ha ha.. Of course there is a dire need to be cute in this otherwise one hell of a hard core tech talk.

  • @tyrotoxin
    @tyrotoxin4 жыл бұрын

    Good entry-level talk, but also would be great to give credits to Leslie Lamport, touch upon CRDTs (Conflict-Free Replication Data Types), mention consensus solutions like RAFT and Paxos, explain SQL vs NoSQL vs NewSQL, say PACELC (extended CAP), add an overview of consistency models (what is strong serializability?), and talk about leader election. I know, too much, but that's the essence of distributed computing!

  • @karthikraghunathan3363

    @karthikraghunathan3363

    4 жыл бұрын

    shameless plug at 5:46

  • @kishorechekuru3904
    @kishorechekuru39042 жыл бұрын

    that z thing is funny, especially in Poland :)

  • @DevoxxPoland

    @DevoxxPoland

    2 жыл бұрын

    :)

  • @TrulyLordOfNothing
    @TrulyLordOfNothing3 жыл бұрын

    The focus of this video is Distributed Systems when writes and reads getting slower on Databases. What about application server getting too many requests? Why is that not covered as part of a problem that DS solves?

  • @paul66766

    @paul66766

    Жыл бұрын

    Because you scale the application server horizontally and load balance across the servers/processes

  • @reg4026
    @reg40263 жыл бұрын

    Anyone noticed that Tim looks like Benji Dunn?

  • @hellelo.5840
    @hellelo.58404 жыл бұрын

    This is Jeff Winger fron Community tv show LOL

  • @ozturkberkayy
    @ozturkberkayy Жыл бұрын

    Fyi, Kafka is not a message queue...

  • @zhehou844
    @zhehou844Ай бұрын

    This is good, but of course, very briefly.

  • @ragingpahadi
    @ragingpahadi3 жыл бұрын

    Gavin Belson ! :p

  • @sinhapratyush
    @sinhapratyush4 жыл бұрын

    cameraman had a tough job :)

Келесі