Kafka Topics, Partitions and Offsets Explained

Ғылым және технология

Learn about Apache Kafka Topics, Partitions and Offsets and their meanings!
If you want to learn more: links.datacumulus.com/apache-...
Get the Learn Apache Kafka for Beginners v3 course at a special price!
Don’t forget to subscribe to get more content about Apache Kafka and AWS!
I'm Stephane Maarek, a consultant and software developer, and I have a particular interest in everything related to Big Data, Cloud and API. I sat on the 2019 Program Committee organizing the Kafka Summit. I'm also an AWS Certified Solutions Architect, Developer, SysOps Administrator, and DevOps Engineer.
My other courses are available here: courses.datacumulus.com/
Follow me on social media:
LinkedIn - / stephanemaarek
Twitter - / stephanemaarek
Medium - / stephane.maarek

Пікірлер: 42

  • @StephaneMaarek
    @StephaneMaarek4 жыл бұрын

    If you want to learn more, check out my Apache Kafka Series - Learn Apache Kafka for Beginners v2 course : links.datacumulus.com/apache-kafka-coupon

  • @irajonah3108

    @irajonah3108

    3 жыл бұрын

    I guess I'm kind of off topic but do anybody know of a good website to stream newly released tv shows online ?

  • @roydouglas7264

    @roydouglas7264

    3 жыл бұрын

    @Ira Jonah try FlixZone. Just search on google for it :)

  • @marcelokairo9092

    @marcelokairo9092

    3 жыл бұрын

    @Roy Douglas definitely, have been using flixzone for since march myself =)

  • @irajonah3108

    @irajonah3108

    3 жыл бұрын

    @Roy Douglas thanks, I went there and it seems to work =) I appreciate it!!

  • @roydouglas7264

    @roydouglas7264

    3 жыл бұрын

    @Ira Jonah Glad I could help :D

  • @777megapixel
    @777megapixel2 жыл бұрын

    That's a kind of a lecture people are usually dreaming of! I'm just getting started with Kafka and your lessons have made my day: thank you

  • @MrBdoleagle
    @MrBdoleagle2 жыл бұрын

    your videos are the best in explaining how kakfa works, clear and neat.

  • @luigitorchia7294
    @luigitorchia72944 жыл бұрын

    Brilliant lecture!!! thank you!

  • @sreenivasamadenahall
    @sreenivasamadenahall3 жыл бұрын

    Thank you, very well explained.

  • @essskkk
    @essskkk3 жыл бұрын

    Great Lecture , Thanks a lot !!!

  • @Gamer_with_knowledge
    @Gamer_with_knowledge Жыл бұрын

    Thanks a lot for these excellent lectures ❣

  • @swapnila202
    @swapnila2024 жыл бұрын

    Owsomely explained 👍

  • @satyaprakashparida5507
    @satyaprakashparida55072 жыл бұрын

    Thanks a lot. I am thinking that I got the best Kafka materials.

  • @ValmikKalathia
    @ValmikKalathia3 жыл бұрын

    Thank you. It was a really nice explanation.

  • @prasadpsp
    @prasadpsp3 жыл бұрын

    A very good tutorial. thank you.

  • @adamnhas7547
    @adamnhas75473 жыл бұрын

    Merci beaucoup. Very clear.

  • @DragonKlavier
    @DragonKlavier3 жыл бұрын

    Thank you so much!

  • @maddymaddy5832
    @maddymaddy5832Ай бұрын

    Best kafka video.. thank you

  • @masonlu100
    @masonlu1003 жыл бұрын

    thanks, very helpful

  • @aaandrade5
    @aaandrade54 жыл бұрын

    honestly this is much better than linuxacademy

  • @ranjulahettiarachchi8525
    @ranjulahettiarachchi85254 жыл бұрын

    Thanks you!

  • @DevWonYoung
    @DevWonYoung4 жыл бұрын

    Thank you sir

  • @PONSONT
    @PONSONT4 жыл бұрын

    Thank you...

  • @cvarun9221
    @cvarun92215 ай бұрын

    The most simplest explanation.

  • @pawegrzesik4449
    @pawegrzesik44494 жыл бұрын

    How make partition we need to create? How to calculate the proper number of it? What if I will have just 1 partition?

  • @dhruvildoshi2368
    @dhruvildoshi23684 жыл бұрын

    Where does kafka stores offsets of all partitions?

  • @yunlin3980
    @yunlin39802 жыл бұрын

    When a consumer is to consume N records from Partition 0, 1, 2 of a topic, what does it mean? Is it reading N records from each partition? That would make it 3N records in total. Is it reading in round-robin fashion from partition 0, 1, 2, until the total read records is N?

  • @roliagrawal3124
    @roliagrawal31248 ай бұрын

    So as u said once it’s written at offset we can not update it that means the same data we can not update it?

  • @meghanapulavarthy4036
    @meghanapulavarthy40363 жыл бұрын

    How to fetch offset for particular events in the consumer??

  • @Pavan-MGM-IT-Training
    @Pavan-MGM-IT-Training2 жыл бұрын

    can some one who is good in PPTs explain how those Message boxes are designed in power point?

  • @aleman7
    @aleman73 ай бұрын

    hi, great video. i'm trying to find a strategy to resolvé transaction for microservicios comunicated each others by Kafka. Do you think that is posible? thanks for your help.

  • @padmanathanramasamy8354
    @padmanathanramasamy8354 Жыл бұрын

    In your truck_gps example, you have created 10 partition and created truckId as a key. In this case the first 10 unique truck id will stored on each partition. what happen when we get the 11th truckId to which partition it will go?

  • @roliagrawal3124

    @roliagrawal3124

    8 ай бұрын

    Yeah same question?

  • @andreisv

    @andreisv

    7 ай бұрын

    Modulo 10 maybe 🤔

  • @andrewkondrashov6485
    @andrewkondrashov64853 жыл бұрын

    What for i have to use partitions?

  • @sushmakl4392
    @sushmakl43922 жыл бұрын

    how do I collect data from Kafka topic as batches and then use poll to send data to Redshift in intervals of time

  • @pradeepb355
    @pradeepb3553 жыл бұрын

    How create dynamic topics

  • @chinmayshetye3
    @chinmayshetye32 жыл бұрын

    nicee

  • @ethanquenum4778
    @ethanquenum47782 жыл бұрын

    You must be french.

  • @pierresun3660

    @pierresun3660

    4 ай бұрын

    no his English is too good for a French