Map Reduce explained with example | System Design

In this video I explain the basics of Map Reduce model, an important concept for any software engineer to be aware of. This will help you identify and apply Map Reduce related questions during your System Design Interviews
Map Reduce Paper: static.googleusercontent.com/...
Follow me on LinkedIn: / bytemonk
System Design Interview Basics Playlist:
► • System Design Intervie...
AWS Certification:
►AWS Certified Cloud Practioner: • How to Pass AWS Certif...
►AWS Certified Solution Architect Associate: • How to Pass AWS Certif...
►AWS Certified Solution Architect Professional: • How to Pass AWS Certif...

Пікірлер: 65

  • @shriyaananthanarayanan
    @shriyaananthanarayanan Жыл бұрын

    thank you so much, today i went to my first day of internship as a 15 year old girl and didn't get the complicated words they explained me but u thought me in a way I will never forget in my whole life. thank you so much!!!!

  • @chanwoopark5397

    @chanwoopark5397

    6 ай бұрын

    where in the world are 15-year olds doing internships that involve map-reduce?? that's wild

  • @jasonwang-wg8wu

    @jasonwang-wg8wu

    5 ай бұрын

    15 is the new 18 (pause)@@chanwoopark5397

  • @backslash8874

    @backslash8874

    4 ай бұрын

    15 year olds, doing internships, and dealing with MapReduce and distributed systems. My 25 years old senior software engineer @$* not being able to comprehend the situation. Which world you live in mah lil sister?

  • @shriyaananthanarayanan

    @shriyaananthanarayanan

    4 ай бұрын

    @@chanwoopark5397 I did the internship in my brothers company so... It wasn't that hard for me to get in...

  • @shriyaananthanarayanan

    @shriyaananthanarayanan

    4 ай бұрын

    @@backslash8874 brotha, it's just like 3 months internship wasn't that hard, my brother is the owner of the company so he just accepted to let me in. I was told to do a couple of work and understand d the concept first, I tried my best to go to internship coz I wanna become a senior like you. And see, that's the difference, I will introduce myself as a intern not a senior like you. 🤗🤗 I really admire you guys,🤗🤗 I waiting to finish my education and I wanna work! Infact I'm kinda girl who watches "the office"😂😂

  • @fishfanaticgokul4758
    @fishfanaticgokul47587 ай бұрын

    Most excited video of 2023 for an diagrammatic representation and clear cut explanation ❤❤❤ really great. College staff wants people like you to teach.

  • @nanaarhin5567
    @nanaarhin55679 ай бұрын

    The most complex name explained with the most simplest scenario. I understand this better now

  • @user-cn1vt9qo9e
    @user-cn1vt9qo9e2 ай бұрын

    The professors we want in Indian engineering colleges ❤

  • @ethanxie2737
    @ethanxie2737 Жыл бұрын

    finally i know what is MapReduce, thanks !

  • @abasahebbhingardeve5464
    @abasahebbhingardeve5464 Жыл бұрын

    Very clear and understanding explanation.

  • @mikedelta658
    @mikedelta658 Жыл бұрын

    What a wonderful explanation!

  • @Sanjaysview
    @Sanjaysview8 ай бұрын

    What a quality sir, hand off

  • @nikhilpathak1948
    @nikhilpathak19484 ай бұрын

    I watched many videos but your's 🔥🔥. I understood, thankyou!! 👏😊

  • @kunalsoni7681
    @kunalsoni76819 ай бұрын

    this video made a complex topic in a very simpler way ♥️☺️💯

  • @user-yk9rr5ir7v
    @user-yk9rr5ir7v Жыл бұрын

    Thank you for this! I have a data engineering interview tomorrow and the example really helped me understand the concept well enough to be able to explain it myself if I am asked.

  • @ByteMonk

    @ByteMonk

    Жыл бұрын

    my latest video on data platform might also help you prepare for the interview, all the best!

  • @ilhemwalker9145
    @ilhemwalker91459 ай бұрын

    thank you so much it's clear and well explained you answered all my whys and whats

  • @johnnyc5467
    @johnnyc5467 Жыл бұрын

    This is a great video. Thank you!

  • @p33yush
    @p33yush Жыл бұрын

    Thank you for awesome explanation!

  • @data-eng-work
    @data-eng-work9 ай бұрын

    thank you so much for this sample , beautiful and benefiting explanation

  • @NassimDAIKH
    @NassimDAIKHАй бұрын

    Excellent video I was looking for a simple explanation like this

  • @azuretutorialclouddesignan8173
    @azuretutorialclouddesignan81739 күн бұрын

    love you bro, u made it easy.

  • @zabinoori49
    @zabinoori49 Жыл бұрын

    nice explanition with all the details thanks bro 💕💕

  • @rookie2048
    @rookie204824 күн бұрын

    I love you man Such a clean explanation

  • @dhaneshpt8641
    @dhaneshpt86415 ай бұрын

    Super presentation.. Thank you sir.

  • @HLearningFun
    @HLearningFun8 ай бұрын

    very nice and informative and detailed. thanks.

  • @thedragonforce2210
    @thedragonforce2210 Жыл бұрын

    i lost my jaw when i saw this video , bravo , nicely done men 👍

  • @emmanuelyaro8322
    @emmanuelyaro8322Ай бұрын

    thank you so much, very clear

  • @avasingh764
    @avasingh764 Жыл бұрын

    His Voice ❤❤️🔥🔥

  • @samathaea8264
    @samathaea8264 Жыл бұрын

    Very helpful. thank you:)

  • @manmeetworld
    @manmeetworld23 күн бұрын

    Best one I've seen yet

  • @landocodes
    @landocodes4 ай бұрын

    Amazing explanation!

  • @nizarhabib4352
    @nizarhabib4352Ай бұрын

    Very nice explanation

  • @dimon_z
    @dimon_z Жыл бұрын

    Bro you are awesome 👍

  • @codernew3191
    @codernew3191 Жыл бұрын

    This is what I wanted

  • @cynthiabock9104
    @cynthiabock91048 ай бұрын

    Thank you for this super helpful video! What I have not understood yet is, how can I turn the process back? For example, if I am looking at the output file, how do I know in how many of those input files has the word 'apple' been? From what I understood, it could have been twice in the first (or second) file or once in each.

  • @yashthakur5712
    @yashthakur57127 ай бұрын

    Excellent explanation

  • @vaibhavahuja4001
    @vaibhavahuja4001 Жыл бұрын

    great vid. thanks

  • @shaikhuzma786
    @shaikhuzma786Ай бұрын

    Tqsm ☺️

  • @teddybear0116
    @teddybear01168 ай бұрын

    Great video! Now do spark!

  • @Veigaburame
    @Veigaburame10 ай бұрын

    the example is pretty straight forward

  • @jasonwang-wg8wu
    @jasonwang-wg8wu5 ай бұрын

    @ByteMonk dank video, very clear and concise but I've got a question: at 8:20 you say we're tasked with finding all the videos with a certain number of likes. Do we really need to go through ALL of the metadata if we're just looking for the condition "number of likes >= [some amount]"??

  • @hermanheinz33
    @hermanheinz3310 ай бұрын

    very good video

  • @samerrawashdeh1351
    @samerrawashdeh1351 Жыл бұрын

    Thanks!

  • @neostark4564
    @neostark4564 Жыл бұрын

    His voice 🗿

  • @ByteMonk

    @ByteMonk

    Жыл бұрын

    I am assuming that's a compliment :)

  • @JayaramB-kw6rs

    @JayaramB-kw6rs

    9 ай бұрын

    ​@@ByteMonkyes it is😅

  • @kartikraj1779

    @kartikraj1779

    7 ай бұрын

    @@ByteMonknah man, although you tried so we appreciate it

  • @mohsenkheirabadi8211

    @mohsenkheirabadi8211

    4 ай бұрын

    I can't focus 😂

  • @abhinavkrishna449
    @abhinavkrishna4495 ай бұрын

    Love you broo

  • @siyaram2855
    @siyaram2855 Жыл бұрын

    🔥

  • @user-ie9tb4pr1c
    @user-ie9tb4pr1cАй бұрын

    thank you so much, but maybe explain the example directly after the motivation next time.

  • @InvincibleMan99
    @InvincibleMan992 ай бұрын

    Amazing explanation sir. Would like to know how FB store likes and comments. Suppose user from India likes a video, and another user from the USA likes the same video, are they stored in same place or in a sharded db (country wise), would like to know your perspective

  • @sawdawyah
    @sawdawyah7 ай бұрын

    Thanx 😊

  • @flameyt3721
    @flameyt37214 ай бұрын

    Failure nodes in classic mapreduce

  • @lucaterraneo7274
    @lucaterraneo727411 ай бұрын

    nice!

  • @ByteMonk

    @ByteMonk

    11 ай бұрын

    Thanks!

  • @bindukhadka
    @bindukhadka22 күн бұрын

  • @sweethasridharan4782
    @sweethasridharan4782Ай бұрын

    Damn you're voice🤌🏼

  • @complexity5545
    @complexity55454 ай бұрын

    Is hadoop dead? Who is still using that.

  • @ByteMonk

    @ByteMonk

    4 ай бұрын

    Hadoop, in its original form, has reached a mature stage. It's less of a buzzword and more of a foundational technology upon which other systems are built. Many companies heavily invested in Hadoop infrastructure during its peak years and still rely on it. For example Yahoo! likely still has large-scale Hadoop systems for storage and batch processing. Facebook has also Built a huge Hadoop infrastructure for data warehousing and analytics. While they've moved a lot of processing to newer systems, legacy Hadoop clusters probably remain. These companies probably don't use Hadoop in exactly the same way they did during its peak. They likely have layered newer technologies like Spark or cloud-based analytics on top of their Hadoop foundations.

  • @TheBoDuddly
    @TheBoDuddly8 ай бұрын

    Excellent explanation!! Thank you.