Пікірлер

  • @SamirJahchan
    @SamirJahchanКүн бұрын

    It was very well presented, in a simple and effective way. This put me on the page about Kafka technology.

  • @moveonvillain1080
    @moveonvillain108010 күн бұрын

    Idk how many videos I went over but not a single one would say that partition in Kafka is JUST A QUEUE. They would unnecessarily make it complicated with more technical jargon. Thank You good Sir🧔‍♂👋🎩

  • @satoshi1285
    @satoshi128517 күн бұрын

    Great Video! I love it!

  • @pepper856
    @pepper85621 күн бұрын

    extremely helpful! Thanks James!

  • @anandrajgunnala5955
    @anandrajgunnala595522 күн бұрын

    Well explained 🙏🏻

  • @mateushesed
    @mateushesed29 күн бұрын

    Please continue with the Golang content! It's so good!

  • @user-rh7xd6ie8z
    @user-rh7xd6ie8zАй бұрын

    Beautiful, thank you!!

  • @James__Bond_007
    @James__Bond_007Ай бұрын

    bless you sir

  • @VisionViral05
    @VisionViral05Ай бұрын

    promotion ka tareeka thoda cazual hai😂

  • @shivamanand8998
    @shivamanand8998Ай бұрын

    To add Kekfa helps to achieve 2 main goals 1. Use Ques for async communication 2. Achieve a pub-sub model

  • @adriancontreras7691
    @adriancontreras7691Ай бұрын

    best explanation ever!

  • @chaosaroundyou8748
    @chaosaroundyou87482 ай бұрын

    simply beautiful, thank you

  • @kshow666
    @kshow6662 ай бұрын

    Great intro to the fundamentals! Great use of example too

  • @wassimchebaane5261
    @wassimchebaane52612 ай бұрын

    thank you for this clear video

  • @Namrata766
    @Namrata7662 ай бұрын

    A great starter video. 😊

  • @kirilnavalihin1222
    @kirilnavalihin12222 ай бұрын

    Simple

  • @ketanjoshi4568
    @ketanjoshi45683 ай бұрын

    Love the brevity of the video !

  • @bensdevjourney7081
    @bensdevjourney70813 ай бұрын

    I love this animation style and want to use one similar for a course's extra credit project! What software did you use to create these if you don't mind me asking?

  • @mberle1
    @mberle13 ай бұрын

    Could there be figures that do not change locations? For example, "A,B,C,D,E" could A ever be the first post-randomiztion?

  • @fullmuppet
    @fullmuppet3 ай бұрын

    Yes. But the same is true with a "real life" shuffle. If you shuffle a deck of cards, any cards could be in the same position after the shuffle. Indeed, to be a true random shuffle, this needs to be the case. If items were guaranteed *not* to be in the same position, that provides information about the previous state, which means it can't be truly random.

  • @jakestandley7668
    @jakestandley76683 ай бұрын

    Great vid!

  • @ashutoshtripathi3817
    @ashutoshtripathi38173 ай бұрын

    thanks!!

  • @manhamvan5909
    @manhamvan59093 ай бұрын

    sub: Apache Kafka is the answer to the problems faced by the distribution and the scaling of messaging systems. let me try to illustrate this by an example imagine we were to design a system that listens to various basketball game updates from various sources such updates might include game scoring participants and timing information it then displays the games status on various channels such as mobile devices and computer browsers in our architecture we have a process that reads these updates and writes them in a queue we call this process a producer since it's producing these updates onto the queue at the head of this queue a number of downstream processes consume these updates to display them on the various channels we call these processes consumers over time we decide to expand and start following more and more games the problem is that our servers are now struggling to handle the load this is mainly because the queue is hosted on one server which is running out of memory and processing capacity our consumers are also struggling in a similar fashion so now we start thinking of how we can add more computing power by distributing our architecture but how do we go about distributing AQ data structure by its nature the items in a queue follow a specific ordering we could try to randomly distribute the contents of the queue onto multiple ones if we do this our consumers might consume the updates in the wrong order this would result in inconsistencies for example the wrong scoring being displayed across the channels one solution is to let the application specify the way to distribute the items in the queue in our example we could distribute the items using the match name meaning that the updates coming from the same match would be on the same queue this strategy would maintain an ordering per basketball match this is the basic fundamental difference of Kafka from other messaging systems that is item sent and received Kafka require a distribution strategy let's have a look at some more detail and terminology used in Kafka each one of these queues is called the partition and the total number of partitions is called a partition count each server holding one or more of these partitions is called a broker and each item in a partition is called a record the field used decide which partition the record should be stored in it's called the partition key it's up to the application to decide which field to use as the partition key if no key is specified Kafka simply assigns a random partition a grouping of partitions handling the same type of data is called a topic in order to identify each record uniquely Kafka provides a sequential number to each record this is called an offset essentially a recording that topic is identified by a partition number and an offset in our application since we have now distributed our data in the topic using the name as the partition key we can now also parallelize our consumer applications having one consumer per partition guarantees ordering per game consumers can live on one machine or distributed amongst multiple ones one important concept in Kafka is that consumers are very lightweight and we can create many of them without affecting performance this is mainly because Kafka only needs to maintain the latest offsets read by each consumer typically consumers read one record after the other and resume from where they left after a restart however in Kafka it's up to the consumer implementation to decide on how to consume records it's quite common to have consumers to read all the records from the beginning on startup or to read the record in different orders such as reading back to front for example in Kafka each consumer belonging to the same consumer group do not share partitions this means that each consumer would read different records from the other consumers multiple consumer groups are useful when you have different applications reading the same contents in our example we could have a consumer group called mobile and another consumer group called computer these groups will read the same records but update different channels each consumer in these groups will have separate offset pointers to keep track which latest record was read if consumers can read using custom ordering how can Kafka determine that the record has been consumed and it can safely delete that record so it can free up space the answer is that tough comp provides various policies that allow it to do a record cleanup for example using irritation policy you can provide a record age limits say 24 hours after which the records are automatically deleted using this policy if your consumer application is never down for more than this age limit no messages are lost another capability of Kafka is to store records in a fault tolerant and durable way each record is stored on persistent storage so that if a broker goes down it can recover when it comes back up additionally Kafka replicates partitions so that when a broker goes down a backup partition takes over and processing can resume this replication is configured using a replication factor for example a replication factor of three leads to three copies of a partition one leader and two backups this means that we can tolerate up to two brokers going down at the same time Kafka can be a solution to your scalability and redundancy problems if the problem is well stated and the technologies are well understood there are of course a lot more technical and implementation details which can be found on kafkas documentation I hope that this short video has been helpful at providing an introduction but the fundamental concepts in Kafka if you like it please give it a thumbs up and subscribe.

  • @thegodfatheram
    @thegodfatheram4 ай бұрын

    Thank you sir very simple and informative explanation

  • @joaocampos9615
    @joaocampos96154 ай бұрын

    Thank you, not many info or vídeos about divolte and avron :)

  • @shanemay-gunlogson9575
    @shanemay-gunlogson95754 ай бұрын

    Best intro to Kafka video I've seen. Thank you.

  • @fryt-zv3tm
    @fryt-zv3tm5 ай бұрын

    what software do you use for illustration?

  • @MirekKrenc
    @MirekKrenc3 ай бұрын

    The same question - what tool did you use to make such nice animations and presentation?

  • @ruiguimaraes9989
    @ruiguimaraes99895 ай бұрын

    Top stuff! Very clear and simple explanation. Thanks!

  • @MirekKrenc
    @MirekKrenc5 ай бұрын

    Nice and clear explanation - thank you.

  • @hadesunseen6388
    @hadesunseen63886 ай бұрын

    thank you for sharing

  • @chrismenui7344
    @chrismenui73446 ай бұрын

    how to scale queue? each queue need it's own distribution strategy replication factor

  • @Sunshine-sv6lw
    @Sunshine-sv6lw6 ай бұрын

    Only a person who has deep knowledge on a subject can explain anything with clarity in a short video. Looking forward to more videos from you!

  • @mikahoy
    @mikahoy6 ай бұрын

    view a lot of videos about kafka, and you 're video is the best one

  • @mosalman5174
    @mosalman51746 ай бұрын

    Simple clear and concise. Thank you James

  • @griglog1309
    @griglog13096 ай бұрын

    Its crazy how good this video is

  • @vijayakumareyunni6010
    @vijayakumareyunni60106 ай бұрын

    Excellent explanation and solution

  • @mhwadah
    @mhwadah6 ай бұрын

    thank you for all the hard work. this is vary informative. ps. could you please tell me what is the application/s used to create the infographics images

  • @onyeukwuhycient438
    @onyeukwuhycient4386 ай бұрын

    This is the best and simplistic explanation I've seen on Muxes so far all over KZread. Thanks a bunch for this great resource

  • @nskmptrck5492
    @nskmptrck54926 ай бұрын

    Thanks a million for this one, from West Africa🎉

  • @anshumanchoudhary4732
    @anshumanchoudhary47327 ай бұрын

    Thanks!

  • @CornPaper
    @CornPaper7 ай бұрын

    great video but, why do you talk like that it was hard to hear what you where talking about, while you stop and start a sentence at random points.

  • @CornPaper
    @CornPaper7 ай бұрын

    sounds like bad AI

  • @gerardtoconnor
    @gerardtoconnor7 ай бұрын

    Love how you break it down into simple concepts, animations on point as usual, thanks James!

  • @tikidai
    @tikidai7 ай бұрын

    Wow! Amazing content in your channels. Much Love ❤️

  • @mr_possible6197
    @mr_possible61977 ай бұрын

    Excellend explanation, thanks!

  • @RohitSingh-em2pm
    @RohitSingh-em2pm7 ай бұрын

    Nice video, but why so few views?

  • @ApnaTechGurukul
    @ApnaTechGurukul7 ай бұрын

    great explanation

  • @desmondwilson3416
    @desmondwilson34167 ай бұрын

    this is a great explanation! Thank you very much,.

  • @himanshugupta-vr3zm
    @himanshugupta-vr3zm7 ай бұрын

    Yesterday I came across your videos, they are super cool. Plz create more technical content like these.

  • @jamescutajar
    @jamescutajar7 ай бұрын

    Thank you. I will try!

  • @NikhilThota-ry5pn
    @NikhilThota-ry5pn7 ай бұрын

    100% Perfect introduction to Kafka

  • @sammiethompson1672
    @sammiethompson16727 ай бұрын

    Thank you so much this was perfect explanation!

  • @djdrastic1
    @djdrastic18 ай бұрын

    Great video this Had a hard time understanding the fundamentals of how it works.